ift  lev  tu 


NATURAL  LANGUAGE  LEARNING 
BY  COMPUTER 

BY 

LAURENT  SIKLOSSY 


SUBMITTED  TO  THE  CARNEGIE- MELLON  UNIVERSITY 
IN  PARTIAL  FULFILLMENT  OF  THE  REQUIREMENTS 
FOR  THE  DEGREE  OF  DOCTOR  OF  PHILOSOPHY 

PITTSBURGH,  PENNSYLVANIA 
i960 


THIS  WORK  WAS  SUPPORTED  PARTIALLY  By  THE  DANFORTH  FOUNDATION  AND 
PARTIALLY  BY  THE  ADVANCED  RESEARCH  PROJECTS  AGENCY  OF  THE  OFFICE 
OF  THE  SECRETARY  OF  DEFENSE  (SD-146)  AND  IS  MONITORED  BY  THE  AIR 

FORCE  OFFICE  OF  SCIENTIFIC  RESEARCH. 


I! 


A8STRACT 


learning  a  natural  language  is  taken  AS  an  IMPROVEMENT  in  a 
SYSTEM'S  ABILITY  TO  EXPRESS  SITUATIONS  IN  A  NATURAL  LANGUAGE. 

THIS  DISSERTATION  DESCRIBES  A  COMPUTER  PROGRAM,  CALLED  Z8JE, 
WRITTEN  IN  IPL-V,  WHICH  ACCEPTS  THE  DESCRIPTION  OF  SITUATIONS  IN 
A  UNIFORM,  STRUCTURED  “UNCTJONAL  LANGUAGE  AND  TRIES  TO  EXPRESS 

these  situations  IN  A  natural  language,  examples  are  given  FOR 

GERMAN  AND#  MOSTLY,  RUSSIAN. 

AT  RUN-TIME,  ZBIE  BUILDS  SIMPLE  MEMORY  STRUCTURES.  PATTERNS 
AND  SETS  ARE  BUILT  ON  THE  FUNCTIONAL  LANGUAGE.  THE  TRANSLATION 
RULES  OF  THE  PATTERNS  AND  AN  IN-CONTEXT  VOCABULARY  PROVIDE  THE 
TRANSITION  TO  THE  NATURAL  LANGUAGE.  ZBIE  IS  A  CAUTIOUS  LEARNER, 
AND  AVOIDS  ERRORS  BY  SEVERAL  MECHANISMS.  ZBIE  IS  CAPABLE  OF  SOME 
EVOLUTIONARY  LEARNING. 
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CHAPTER  I 


INTRODUCTION. 

WORKERS  IN  ARTIFICIAL  INTELLIGENCE  HAVE,  AS  ONE  OF  THEIR 
GOALS,  THE  WRITING  OF  S03HISTI GATED  COMPUTER  PROGRAMS  WHICH  WILL 
PERFORM  *  INTERESTING’  AND  'DIFFICULT*  TASKS.  PROGRAMS  CAN  IMPROVE 
THEIR  SOPHISTICATION  BY  LEARNING,  AND  LEARNING  Is,  INDEED,  A 
CENTRAL  PROBLEM  OF  ARTIFICIAL  INTELLIGENCE. 

ONE  OF  THE  FIRST  LEARNING  TASKS  THAT  HUMAN  BEINGS  PERFORM  Is 
ACQUIRING  A  NATURAL  LANGUAGE  t ABBREVIATED  NL>.  THROUGHOUT  HISTORY 
MEN  HAVE  USED  NL’S  FOR  COMMUNICATING  AMONG  THEMSELVES  AND 
INVESTIGATING  AND  INTERACTING  WITH  THE  WORLD.  FOR  THE  PAST 
DECADE,  NATURAL  LANGUAGE  COMMUNICATION  OF  HUMANS  WITH  COMPUTERS 
HAS  BEEN  AN  ACTIVE  AREA  OF  INTEREST  IN  ARTIFICIAL  INTELLIGENCE. 

INTERESTS  IN  THE  FIELDS  OF  LEARNING  AND  NATURAL  LANGUAGE  ARE 
COMBINED  HERE  IN  A  PROGRAM  CALLED  ZBIE  THAT  ATTEMPTS  TO  LEaRN 
NATURAL  LANGUAGES  AT  AN  ELEMENTARY  LEVEL.  THE  TASK  IS  CONSIDERED 
WORTHY  OF  INVESTIGATION  IN  ITS  OWN  RIGHT;  THE  PROGRAM  DOES  NOT 
TRY  TO  SIMULATE  THE  LEARNING  BEHAVIOR  OF  HUMAN  BEINGS. 

NATURAL  LANGUAGE  LEARNING  PROGRAMS  HAVE  BEEN  FEW.  TO  THE 
BEST  OF  THE  AUTHOR’S  KNOWLEDGE,  CORROBORATED  BY  A  REVIEW  OF 


RECENT  WORK  IN  ARTIFICIAL  INTELLIGENCE  (SOLOHONOFr  1966),  Only 
ONE  WORK  CAN  QUALIFY  »  UHR  1964.  BY  A  PROCESS  OF  STRING  MATCHING 
AND  STATISTICAL  LEARNING,  UHR'S  PROGRAMS  ATTEMPT  TO  TRANSLATE 
STRINGS  FROM  ONE  NL  (NL1>  INTO  STRINGS  OF  ANOTHER  NL  (NL2).  THE 
PROGRAMS  ARE  INSUFFICIENTLY  DOCUMENTED  TO  EXPLAIN  THEIR  STRUCTURE 
IN  DETAIL,  BUT  FROM  THE  OJTPUTS  EXHIBITED,  SEVERAL  LIMITS  APPEAR* 
THE  IDIOSYNCRASIES  OF  NL1  GIVE  DIFFICULTIES  TO  THE  PROGRAMS  AND 
THE  LEARNING  PROCESS  SEEMS  TO  CYCLE. 

A  POSSIBLE  CAUSE  FOR  THE  LACK  OF  INTEREST  IN  NL  LEARNING 
PROGRAMS  IS  THE  FEELING.  AMONG  MANY  LINGUISTS.  THAT  THE  LANGUAGE 
LEARNING  TASK  IS  EXTREMELY  ARDUOUS.  TWO  OF  THE  FOREMOST 
SCIENTISTS  IN  THE  FIELD  OF  MODERN  LINGUISTICS  STATED  (CHOMSKY  AND 
MILLER,  1963)* 

TO  IMAGINE  THAT  AN  ADEQUATE  GRAMMAR  COULD  BE  SELECTED  FROM  THE 
INFINITUDE  OF  CONCEI VA3LE  ALTERNATIVES  BY  SOME  PROCESS  OF  PURE 
INDUCTION  ON  A  FINITE  CORPUS  OF  UTTERANCES  IS  TO  MISJUDGE 
COMPLETELY  THE  MAGNITUDE  OF  THE  PROBLEM. 

TWO  RELATED  AREAS  HAVE  RECEIVED  MUCH  MORE  ATTENTION!  THE 
INDUCTION  OF  GRAMMARS  OF  ABSTRACT  LANGUAGES  AND  THE  EXTRAPOLATION 
OF  SEQUENCES.  SOLOMONOFF  (1958)  OFFERED  A  SKETCH  FOR  THg 
MECHANIZATION  OF  LINGUISTIC  LEARNING,  WHICH  DOES  NOT  APPEAR  TO 
HAVE  BEEN  PROGRAMMED,  AMD,  LATER  (1964),  H I S  FORMAL  THEORY  OF 
INDUCTIVE  INFERENCE  PRESENTS  VARIOUS  MODELS  FflR  EXTRAPOLATING  A 
LONG  SEQUENCE  OF  SYMBOLS  CONTAINING  ALL  DATA  TO  BE  USED  IN  THE 
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PREDICT10N,  A  PROBABILISTIC  APPROACH  IS  USED.  SlMON  AND  KOTOVSKY 
(1963)  DESCRIBE  PROGRAMS  THAT  INDUCT  RULES  TO  EXPLAIN  THE 

formation  of  given  serial  alphabetic  patterns,  the  rules  can  then 

BE  APPLIED  TO  CONTINUE  THE  PATTERN.  PIVAR  AND  FlNKELSTEIN  (1964) 
REPORTED  ON  A  SIMILAR,  PERFORMANCE-OR I ENTED  PROGRAM  WHICH  ALSO 
HANDLES  INTEGER  STRINGS.  (FOR  A  REVIEW  OF  RECENT  RESEARCH#  SEE 
SOLOMONOFF,  1966).  IN  EITHER  AREA,  THE  STRINGS  CONSIDERED  ARE 
’  EMPTY ' J  THEY  LACK  THE  CONTENT  THAT  NATURAL  LANGUAGES  POSSESS  AS 
WAYS  OF  EXPRESSING  SITUATIONS  OF  OUR  HUMAN  ENVIRONMENT, 

BEFORE  TRYING  TO  DEFINE  THE  LEARNING  TASK,  LET  US  CONSIDER 
THE  TECHNIQUE  FOR  TEACHING  LANGUAGES  (TO  HUMANS)  USED  BY  I .  A. 
RICHARDS  AND  HIS  CO-WORKERS  (RICHARDS,  1961).  IV  THE  LANGUAGE  - 
THROUGH  -  PICTURES  SERIES#  PICTURES  ARE  ASSOCIATED  WITH  SENTENCES 
IN  AN  NL  TO  BE  LEARNT.  THE  PICTURES  ARE  TO  ACT  AS  A  GENERAL 
REPRESENTATION  FOR  ALL  HUMAN  BEINGS  ( » ENGL  I SH  THROUGH  PICTURES, 
BOOK  P  IS  PREFACED  IN  41  LANGUAGES).  THE  STUDENT  IS  SUPPOSED  TO 
USE  THE  PICTURES  AS  CLUES  TO  THE  MEANING  OF  THE  SENTENCES  AND#  BY 
SUCCESSIVE  COMPARISONS  OF  THE  SENTENCES,  TO  INFER  THE  VOCABULARY 
AND  GRAMMAR  OF  THE  NL  STUDIED. 

THE  STUDENT’S  OWN  MAIN  OR  MOTHER  TONGUE  IS  BYPASSED,  THEREBY 
AVOIDING  PROBLEMS  OF  TRANSLATION  FROM  ONE  TONGuE  INTO  ANOTHER  J 
INSTEAD  THE  STUDENT  LEAR  VS  TO  TRANSLATE  SITUATIONS  DIRECTLY  FrOM 
•REALITY’  INTO  A  NEW  NL. 


(AS  AN  ASIDE,  THE  AUTHOR  MAY  ADD  THAT  HE  TRIED  TO  LEARN 
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HE8«EW,  ABSOLUTELY  UNKNOWN  BEFOREHAND,  FROM  ’HEBREW  THROUGH 
PICTURES’,  HE  HAD  THE  ADVANTAGE  OF  HAVING  HaD  READ  PREVIOUSLY 
SEVERAL  OTHER  'LANGUAGE  THROUGH  PICTURES’  BOOKS  IN  KNOWN 
LANGUAGES!  NEVERTHELESS  HE  HAD  GREAT  DIFFICULTIES  IN  TRYING  TO 
DETERMINE  THE  MEANINGS  OF  THE  PICTURES  OR  THE  CLUES  TO  BE  DERIVED 
FROM  THEM,  AND  HE  FINALLY  ABANDONED  THE  ENDEAVOUR.  SEVERAL  OTHER 
PERSONS  REPORTED  1DENTICA.  DIFFICULTIES.) 

THE  PHILOSOPHIES  8EHIND  28 1 E  AND  I.  A.  RICHARDS’S  BOOKLETS 
ARE  SIMILAR.  2B I E  USES  A  FUNCTIONAL  LANGUAGE  (ABBREVIATED  FL>  TO 
REPRESENT  SITUATIONS)  FL  HAS  THE  SAME  FUNCTION  IN  ZBIE  AS  THE 
PICTURES  IN  RICHARDS.  BY  SUCCESSIVE  COMPARISONS  OF  SITUATIONS,  AS 
REPRESENTED  IN  FL  AND  AS  EXPRESSED  IN  AN  NL,  ZB  I E  TRIES  TO  LEaRN 
HOW  TO  EXPRESS  OTHER  SITUATIONS  REPRESENTED  IN  FL  AND,  FAILING 
THAT,  TO  USE  ITS  PREVIOUS  KNOWLEDGE  TO  TRY  TO  LEARN  HOW  TO 
EXPRESS  THE  OTHER  SITUATIONS.  THE  LEARNING  SEQUENCE  USED  IS  TAKEN 
FROM  'RUSSIAN  THROUGH  PICTURES'  WITH  SLIGHT  MODIFICATIONS. 

CHAPTER  II  IS  DIVIDED  INTO  THREE  PARTS. 

IN  PART  A,  WE  D6SCRI3E  FL  BRIEFLY. 

IN  PART  B,  WE  DESCRIBE  THE  INTERNAL  REPRESENTATIONS  USED  BY 
ZB  I E I  PATTERNS,  SETS,  TRANSLATION  RULES  AND  IN-CONTEXT 
VOCABULARY. 

IN  PART  C,  WE  DESCRIBE  THE  ORGANIZATION  OF  ZB  I E  AND  THE  MAIN 


PROCESSOR  ROUTINES. 
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SINCE  CHAPTER  II  IS  RATHER  DETAILED,  THE  READER  MAY  WELL 
WANT  TO  COME  BACK  TO  IT  A"TER  READING  THE  FOLLOWING  CHAPTER. 

CHAPTER  III  COMMENTS  ON  ZBIE'S  LEARNING  OF  RUSSIAN. 

CHAPTER  IV  COMPARES  ZBIE  WITH  UHR'S  PROGRAMS  AND  DISCUSSES 
SOME  OF  ZBIE«S  INADEQUACIES. 

APPENDIX  A  SHOWS  THE  CODE  USED  TO  TRANSLATE  THE  RUSSIAN 
CYRILLIC  ALPHABET  INTO  LATIN  ALPHANUMER I CS . 

APPENDIX  8  GIVES  A  SIMPLE  EXAMPLE,  IN  GERMAN,  OF  ZBIE’S 
•evolutionary  learning*  capabilities. 

Z8IE  is  CODED  IN  I3L-V  (NEWELL,  1964)  AND  HAS  BEEN  RUN  ON 
THE  CARNEGIE-MELLON  UNIVERSITY  CDC  G-Pl  COMPUTER.  SINCE  IPL-V 
CODE  IS  TYPICALLY  UNREADABLE,  THE  PROGRAM  IS  NOT  ENCLOSED,  BUT  IT 
IS  DESCRIBED  SEM I -FORMALLY  IN  CHAPTER  II,  PART  C. 


CHAPTER  II 


A.  THE  FUNCTIONAL  LANGUAGE,  FL. 


THE  PURPOSE  OF  FL  IS  TO  REPRESENT  SITUATIONS  IN  A  FASHION 
SOMEWHAT  SIMILAR  TO  THE  PICTURES  (AND  PICTURE  LANGUAGE)  USED  IN 
THE  LANGUAGE  -  THROUGH  -  PICTURES  SERIES.  THE  MAIN  SPIRIT  BEHIND 
FL  MAY  BE  SUMMARIZED  THUS  t  ’SIMILAR  SITUATIONS  SHOULD  HAVE 
SIMILAR  REPRESENTATIONS  IN  FL  * ,  WHERE  AN  INTUITIVE  FEELING  FOR 
SIMILARITY  IS  USED,  FOR  EXAMPLE  THE  SENTENCES  « 

THIS  IS  A  HAT. 

THIS  IS  HIS  HAT.  (REFERRING  TO  A  BOY) 

THIS  IS  THE  BOY’S  HAT. 

SHOULD  HAVE  SIMILAR  REPRESENTATIONS  IN  FL.  TO  AVOID 
IDIOSYNCRASIES  OF  NL’S,  FL  IS  NOT  INFLECTED  AND  OMITS  ARTICLES 

to  Improve  its  descriptive  power  we  have  added  some  semantics 

FOR  INSTANCE  THE  REFERENT  OF  PRONOUNS  IS  SPECIFICALLY  MENTIONED: 
HE*(MAN)  OR  YOU= ( SPOKEN  BOY)  IF  THE  PERSON  SPOKEN  TO  IS  A  BOY 
(REMEMBER  THE  PICTURES). 


FL 

IS 

NOT 

UNLIKE  THE 

LANGUAGE 

described 

by  reichenbach 

(1947) 

FOR 

HIS 

ANALYSIS  OF 

ENGLISH. 

instead 

OF  THE  USUAL 

FUNCTIONAL  NOTATION  F(X1,  X2»...,  XN>  WE  USE  A  LlSP-LIKE  NOTATION 
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(MCCARTHY  1963),  (F  XI  X2  ...  XN)  AMD  ALSO  USE  DESCRIPTION  LISTS, 
ENCLOSED  IN  SQUARE  BRACKETS  t  AMD  1. 

VERBS  AND  FUNCTION  WORDS  ARE  TREATED  AS  N-PLACE  FUNCTIONS. 
A  FEW  EXAMPLES  SHOULD  MAKE  SOME  OF  THE  ELEMENTARY  CONSTRUCTIONS 
CLEAR. 


FL 

(BE  HAT) 

(86  HATtOF  BOY) ) 

( B6  HATIOF  (BOY) ) ) 
(C  BE  BOOK  HERE) 

(86  (ON  HAT  TABLE)) 


ENGLISH  EQUIVALENT 
THIS  IS  A  HAT 
THIS  IS  THE  BOY’S  HAT 
THIS  IS  HIS  HAT 
IS  THE  BOOK  HERE  Q 
THE  HAT  IS  ON  THE  TABLE 
THE  TABLE  IS  ON  THE  HAT 
HIS  HAT  IS  ON  THE  TABLE 


(BE  (ON  TABLE  HAT)) 

(BE  (ON  HATIOF  (BOY)J  TABLE)) 

(BE  (IN  (AND  HAT  BOOK)  DRAWER)) 

THE  HAT  AMD  THE  BOOK  ARE  IN  THE  DRAWER 
(BE  (IN  ((AND  HAT  BOOK))  (DRAWER)))  THEY  ARE  IN  IT 

INPUT  TO  ZBIE  IS  IN  THE  FORM  OF  I  PL V  LIST  STRUCTURES 
EQUIVALENT  TO  THE  ABOVE  NOTATION.  THE  MOST  IMPORTANT  FEATURES  OF 
FL  SEEM  TO  BE  ITS  UNIFORMITY  AND  STRUCTURE  5  FL  SENTENCES  ARE 
USUALLY  TREES,  NOT  STRINGS. 

TO  MAKE  EXPLICIT  THE  STRUCTURE  OF  THE  TREES  IN  FL,  IT  IS 
SUFFICIENT  TO  DEFINE  A  RECOGNIZER  FOR  THE  TERMINAL  NODES  OF  THE 
TRE6S.  THE  FOLLOWING  ARE  TERMINAL  NODES’. 
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-  AN  ATOMIC  SYMBOL  (i.E.  AN  IPL-V  REGIONAL) 

EXAMPLE l  BE,  TABLE,  30Y,  2. 

-  C < 4 T 0 M I C  SYMBOLX 

EXAMPLE!  (BOY). 

-  (SPEAKING  <ANY  FL  CONSTRUCT>) 

EXAMPLE!  (SPEAKING  BOY). 

-  (SPOKEN  <ANY  FL  CONSTRUCTX 

EXAMPLES  (SPOKEN  BOY  t  NUMB  2)),  WHERE  NUMB  «  NUMBER . 

-  (<AT0MIC  SYMBOLXNUMB  <ATOMIC  SYM80L>)> 

EXAMPLES  (MAN (NUMB  2)  )  . 

-  <ATOM I C  SYMBOLXNUMB  =LUR1*  WHERE  PLUR  =  PLURAL. 

EXAMPLES  BOY ( NUMB  PLUR 1 . 

THE  TERMINAL  NODES  IN  Fl  ARE  CALLED  FL  UNITS.  ALL  OTHER 
CONSTRUCTS  IN  FL  ARE  FL  COMPLEX  STRUCTURES.  THE  PROGRAM 
•UNDERSTANDS*  FL  TO  THE  EXTENT  THAT  IT  RECOGNIZES  THE  FL  UNITS  OF 
AN  FL  STRUCTURE. 

(IN  THE  IPL-V  IMPLEMENTATION,  THE  SQUARE-BRACKETED 
DESCRIPTION  LIST  ACTUALLY  OCCURS  ABOVE  THE  FL  UNIT  THAT  Is 
DESCRIBED,  SO  THAT  HAT  l  OF  BOY)  LOOKS  LIKE  ((OF-  BOY)  HAT)  WREN 
CONSIDERED  PURELY  AS  A  LIST  STRUCTURE.  FOR  AN  EXAMPLE,  SEE  THE 
IPL-V  DESCRIPTION  OF  SENTENCE  3  IN  APPENDIX  8.  THE  ORDER 
•DESCRIPTION  LIST  -  DESCRIBED  FL  UNIT*,  IS  MAINTAINED  IN  THE 
PATTERN  STRUCTURES,  TO  BE  DESCRIBED.  FOR  AN  EXAMPLE,  SEE  CHAPTER 


III,  SENTENCE  12.) 


AT  THIS  STAGE  FI  IS  A  TOOL,  TO  BE  MODIFIED  IF  NECESSARY.  WE 
MAKE  NO  CLAIM  THAT  IT  IS  *  THE '  REPRESENTATION,  OR  THAT  IT  IS 
UNIVERSAL.  IT  IS  DOUBTFUL  THAT  THE  PICTURE  LANGUAGE  IS  UNIVERSAL. 
FOR  INSTANCE,  IN  ’GERMAN  THROUGH  PICTURES’,  P.  239,  A  GERMAN  BOY 


PLAYS  BASEBALL. 
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8.  THE  PROGRAM'S  INTERNAL  REPRESENTATION. 

AT  RUN-TIME,  ZB  I E  BUILDS  AND  THEN  USES  CERTAIN  MEMORY 
STRUCTURES  WHICH  WILL  NOW  BE  DESCRIBED. 

1  -  THE  PATTERN. 

THE  MAIN  WORKING  STRUCTURE  IS  THE  PATTERN,  WHICH  IS  USED  To 
MATCH  FL  STRUCTURES,  AND  THEN.  USING  THE  PATTERN'S  TRANSLATION 
RULE#  TO  TRANSLATE  THE  FL  STRUCTURES  INTO  NL.  THERE  ARE  TWO  TYpES 
OF  PATTERNS,  DIFFERENTIATED  BY  A  MARKER  ON  THE  DESCRIPTION  LIST 
(D.L.I  OF  THE  PATTERN.  A  TOP  PATTERN  IS  USED  TO  MATCH  FL 
SENTENCES)  A  SUBPATTERN  TO  MATCH  FL  COMPLEX  SUBSTRUCTURES.  A 
PATTERN  IS  AN  ORDERED  LIST  OF  PAIRS)  EACH  PAIR  CONSISTS  OF  THE 
NAME  OF  A  SET  AND  AN  EXTRACTOR.  ON  THE  D.L.  OF  THE  PATTERN  IS  THE 
TRANSLATION  RULE  OF  THE  PATTERN,  AND  OTHER  INFORMATION. 

A  MORE  FORMAL  DESCRIPTION  OF  A  PATTERN  CAN  BE  GIVEN  IN 
B.N.F,  I 

<PATTERN>  M=  <3~LISTXDESCRIPTI0N  LIST> 

<P-LtST>  tl=  <5ET  NAMEXEXTRACTOR>  I 

<SET  NAMEXEXTRACTCRXP-LIST> 

DESCRIPTION  LIST>**«  <  ATTRIBUTE  XV  ALUE>  I 


<ATTRIBUTEXVALUEXDESCRleTION  LIST> 
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<SET  NAME> 
<eXTRACTOR> 
<ATTR!SUTE> 
<VALUE> 


It*  A1IA2IA3  ...ETC... 

Ms  Y  i  I  Y  2  I  Y  3  ...ETC... 

11=  < ! PL-V  REGIONAL  OR  INTERNAL  SYM80L> 
11=  < I PL-V  LIST  STRUCTURE> 


IN  IPL-V,  A  PATTERN  IS  A  SIMPLE  DESCRlBABLE  LIST. 


THE  ELEMENTS  OF  A  SET  ARE  FL  UNITS  OR  ( hECURSI VEL V ) 
PATTERNS*  WHICH  ARE  THEN  REFERRED  TO  AS  SUBPATTERNS.  A  SET  CAN 

also  be  empty. 


THE  TRANSLATION  RULE  OF  A  PATTERN  IS  A  FUNCTION  OF  THE 


EXTRACTORS  OF 

THE 

PATTERN. 

EXAMPLEl 

<P2> 

<9-1 

=  26178> 

<9-2  =  26170> 

<9-3  =  262nn> 

02  9-1 

04 

0 

04  0 

04  0 

00  A4 

00 

TO 

00  Yl 

00  Yl 

00  Yl 

02 

9-2 

00  Y2 

00  Y2 

00  A3 

00 

D12 

00  Y2 

02 

9-3 

00 

D13 

04 

26180 

THE  EXAMPLES  ARE  TAKEN  FROM  CHAPTER  III.  P2  IS  THE  NAME  OF  THE 
PATTERN!  ITS  P-LIST  IS  <A4  Y1  A3  Y2)J  ITS  DESCRIPTION  LIST  IS  THE 
LIST  STRUCTURE  9-1.  THE  SETS  ARE  A4  AND  A3 !  THE  EXTRACTORS  ARE  Yl 
AND  Y2 .  THE  TRANSLATION  RULE  OF  THE  PATTERN  IS  T0<P2>=9-2,  THE 
LIST  (Yl  Y2>. 

ALL  OTHER  ATTRIBUTE  -  VALUE  PAIRS  ON  THE  D.L.  OF  THE 
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PATTERNS  MAY  BE  DISREGARDED  AT  THE  PRESENT. 

to  understand  the  function  of  the  extractors#  let  us 

DESCRIBE  THE  PROCESS  WHICH  MATCHES  AN  Ft  STRUCTURE  TO  A  PATTERN. 

2  -  ELEMENTARY  DESCRIPTION  OF  THE  MATCHING  ROUTINE. 

LET  US  ASSUME  THAT  WE  WANT  TO  MATCH  THE  FL  SENTENCE  <8E  BOY) 
TO  P2.  WE  GO  DOWN  THE  SENTENCE  AND  THE  P-LlST  OF  THE  PATTERN  IN 
PARALLEL.  WE  CHECK  WHETHER  THE  FIRST  ELEMENT  OF  THE  FL  SENTENCE 
(HERE#  'BE')  IS  A  MEMBER  OF  THE  FIRST  SET  ON  THE  P-LIST  OF  THE 
PATTERN  (HERE#  A4>.  IN  OUR  CASE#  'BE'  IS  A  MEMBER  OF  A4,  AND  WE 
SAY  THAT  'BE'  WAS  (SUCCESSFULLY)  MATCHED  TO  A4.  'BE*  IS  THEN 
PLACED  ON  THE  DESCRIPTION  LIST  OF  Y1 l  Y1  HAS  'EXTRACTED*  THE 
ELEMENT  OF  THE  FL  SENTENCE  WHICH  WAS  MATCHED  TO  A4.  THE  MATCHING 
ROUTINE  LOOPS  BACK  AND  TESTS  WHETHER  THE  SECOND  ELEMENT  OF  THE  FL 
SENTENCE  (HERE.  'BOY')  IS  A  MEMBER  OF  THE  SECOND  SET  ON  THE 
P-LIST  OF  THE  PATTERN  (HERE,  A3),  ETC... 

WHEN  WE  WANT  TO  TRANSLATE  THE  MATCHED  FL  SENTENCE  INTO  NL, 
WE  USE  THE  TRANSLATION  RULE  OF  THE  PATTERN.  THE  TRANSLATION  RULE 
OF  P2  IS  TO  ( P2 )  =  ( Y1  Y2>.  THE  MEANING  OF  THE  TRANSLATION  RULE  IS 
AS  FOLLOWS*  TAKE  THE  ELEMENT  EXTRACTED  BY  Yl#  'BE',  TRANSLATE  IT 
IN  THE  APPROPRIATE  CONTEXT  (HERS,  THE  CONTEXT  CONSISTS  OF  THE  SET 
A4,  OF  WHICH  'BE'  WAS  A  MEMBER,  AND  OF  THE  PATTERN  P2),  THEN 
FOLLOW  THIS  TRANSLATION  ( ' E2T0  ’ )  BY  THE  TRANSLATION  OF  THE 
ELEMENT  EXTRACTED  BY  Y2#  'BOY',  IN  THE  PROPER  CONTEXT  (HERE,  THE 
SET  A 3  AND  THE  PATTERN  P2>.  THE  SECOND  TRANSLATION  IS  ' MAL1Y I K ' , 
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so  that  the  TOTAL  transition  is  *e?to  maliyik*.  if  we  cannot 

FIND  A  TRANSLATION  FOR  'BOYS  WE  INSERT  A  *2»  IN  THE  TOTAL 
TRANSLATION,  WHICH  WOULD  3ECOME t  »E?TO  2*. 

IT  MAY  HAPPEN  THAT,  FOR  EXAMPLE,  THE  SECOND  ELEMENT  OF  FL  IS 
NOT  AN  FL  UNIT,  (SEE  SENTENCE  15?,  CHAPTER  HI).  THE  MATCHING 
ROUTINE  THEN  TRIES,  RECURSIVELY,  TO  FIND  IN  A3  A  SUBPaTTERN  WHICH 
CAN  MATCH  THE  SECOND  ELEMENT  OF  FL. 

THE  MATCHING  ROUTINE  USES  ONLY  SET  INCLUSION  TESTS,  BUT  USES 
THEM  RECURSIVELY.  IT  IS  SEEN  THAT  A  NECESSARY  CONDITION  FOR  MATCH 
IS  THAT  THE  LENGTH  OF  THE  FL  STRUCTURE  AT  ITS  TOP  LEVEL  BE  EQUAL 
TO  THE  NUMBER  OF  PAIRS  (SET,  EXTRACTOR)  IN  THE  PATTERN.  THE 
MATCHING  ROUTINE  WILL  8E  CONSIDERED  IN  DETAIL  IN  CHAPTER  II,  PART 
C. 

3  -  THE  TRANSLATION  RULE. 

THE  TRANSLATION  RULE  TO (PATTERN)  IS  A  FUNCTION  FROM  THE 
EXTRACTORS  OF  THE  PATTERN  INTO  NL  AUGMENTED  BY  Z'S,  WHERE  A  Z 
INDICATES  THAT  SOMETHING  WAS  NOT  TRANSLATED.  A  FEW  EXAMPLES 
FOLLOW • 


A)  LINEAR  ARRANGEMENT  OF  THE  EXTRACTORS! 


<P37> 

<9-1  =  26506> 

<9-2  =  27334> 

<9-3 

=  2?1a 

02  9-1 

04  0 

04  0 

04 

0 

00  A12 

00  TO 

00  Y96 

00 

Y96 

00  Y97 

02  9-2 

00  Y97 

00 

Y97 

00  A2 

00  D12 

00  Y95 

00 

Y95 

“14“ 


00 

Y96 

02 

$-3 

00 

A13 

00 

D13 

00 

Y95 

04 

27144 

00 

D9 

00 

A14 

00 

VO 

00 

J4 

THE  TRANSLATION  RULE  OF  P37  IS  T0(P37)  «  (Y96  Y97  Y95>,  AND 
IS  TO  BE  READ  AS  FOLLOWS!  LOOK  UP  IN  THE  VOCABULARY,  IN  T»E 
PROPER  CONTEXT  (HERE,  OF  THE  SET  A2  AND  THE  PATTERN  P37)>  THE 
TRANSLATION  OF  THE  PART  OF  THE  FL  STRUCTURE  THAT  WAS  HATCHED  TO 
A2J  THEN  FOLLOW  THIS  TRANSLATION  BY  THE  TRANSLATION,  IN  THE 
PROPER  CONTEXT,  OF  THE  PART  OF  THE  FL  STRUCTURE  THAT  WAS  HATCHED 
TO  A12,  ETC... 

B)  LINEAR  ARRANGEMENT  OF  SOME  OF  THE  EXTRACTORS. 


<P1> 

<9-1  s  25418> 

<9-2  «  85752> 

<9-3  = 

02  9-1 

04  0 

04  0 

04  0 

00  A1 

00  PO 

00  PO 

00  Y2 

00  Y1 

02  9-2 

00  Y3 

00  A2 

00  YO 

00  Y2 

00  J3 

00  A3 

00  J4 

00  Y3 

00  J3 

00  TO 

02  9-3 
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THE  TRANSLATION  RULE  OF  PI  IS  T0<Pl>  *  < Y2  Y3*.  IT  IS  TO  BE 
READ  AS  IN  CASE  A)  ABOVE.  NOTICE  THAT  THE  EXTRACTOR  Yl  IS  MISSING 
IN  THE  TRANSLATION  RULE.  SUCH  A  RULE  CAN  BE  USED  UHEN  SOME  FL 
PART  IS  NOT  EXPRESSED  IN  ML. 

C)  QROUPING  OF  SOME  EXTRACTORS. 

<P0>  <9-1  *  2541fl>  <9-2  *  25228>  <9-3  =  2e55?*> 


02 

9-1 

04  0 

04  0 

04 

0 

00 

Al 

00  TO 

02  9-3 

00 

Yl 

00 

Yl 

02  9-2 

0  0  Y3 

00 

Y2 

00  A2 
00  Y2 
00  A3 
00  Y3 

THE  TRANSLATION  RULE  IS  TO  BE  READ  AS  FOLLOwSi  TAKE  THE  Fl 
STRUCTURE  THAT  WAS  MATCHED  TO  Al,  FOLLOW  THIS  STRUCTURE  BY  THE  FL 
STRUCTURE  THAT  WAS  MATCHED  TO  A?)  THEN  LOOK  UP  THIS  FL  COMPLEX 
STRUCTURE  IN  THE  VOCABULARY  IN  THE  PROPER  CONTEXT  (HERE,  OF  THE 
PATTERN  PO).  THE  NL  STRING  OBTAINED  IS  FOLLOWED  BY  THE 
TRANSLATION  OF  THE  ELEMENT  EXTRACTED  BY  Y3,  AS  ABOVE,  TO  GIVE  THE 
TRANSLATION  OF  THE  STRUCTURE  MATCHED  TO  PO. 

EXAMPLE l  (CHAPTER  III,  SENTENCE  1.)  IF  WE  MATCH  (BE  (MaN) 
HERE)  TO  PO,  WE  SHALL  LOOK  U»  THE  FL  COMPLEX  (BE  (MAN))  IN  THE 
VOCABULARY,  AND  FOLLOW  THE  TRANSLATION  OF  (BE  (MAN))  BY  THE 
TRANSLATION  OF  'HERE*  (IN  THE  PROPER  CONTEXT). 
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THE  ABOVE  THREE  FUNCTIONS  ARE  NOW  USED  BY  ZBlE,  NOTE  THAT 
SINCE  THE  FL  STRUCTURE  HATCHED  TO  Ai,  SAT,  CAN  BE  A  COMPLEX  FL 

part,  a  recursive  translation  look-up  is  implicit  in  the 
translation  rules,  for  a  detailed  example,  see  CHAPTER  in, 
SENTENCE  12, 

THE  TRANSLATION  RULE  FUNCTIONS  CAN  BE  GENERALIZED 
IMMEDIATELY.  TWO  EXAMPLES  OF  DIFFERENT  TRANSLATION  RULES  FOLLOW, 
AND  MANY  MORE  COULD  BE  DREAMED  UP,  C WE  ASSUME  A  PATTERN  WITH 
EXTRACTORS  Y20  AND  Y21 >  * 

D)  INTRODUCTION  OF  CONSTANTS. 

92  0 

Y21 
NLI 
Y20  0 

WHERE  NLI  IS  SOME  STRING  IN  NL.  SUCH  A  RULE  COULD  BE  USED  WREN 
SOME  EXPRESSION  IN  NL  HAS  IDIOMATIC  FILLERS. 

E)  DISJOINT  PARTS. 

92  0 

F I RST ( Y21 ) 

Y20 

SECOND ( Y21 )  0 

WHERE  FIRST  AND  SECOND  ARE  FUNCTIONS  (WHICH  MUST  BE  DEFINED)  ON 
THE  TRANSLATION  OF  THE  FL  STRUCTURE  WHICH  WAS  EXTRACTED  BY  Y2l. 
SUCH  A  RULE  COULD  BE  USED  TO  HANDLE  SEPARABLE  GERMAN  VERBS. 
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4  -  THE  IN-CONTEXT  VOCABULARY. 

THE  VOCABULARY  OF  ZBIE  HAS  THE  TWO  FOLLOWING  FORMS  * 

A)  FL  UNIT*FLU>,  SET=A<J),  PATTERNS  t  K ) ,  NL  STrING  =  NL(L)  . 

TO  BE  INTERPRETED*  THE  TRANSLATION  OF  THE  FL  UNIT  FLU)  WHEN  A 
MEMBER  OF  THE  SET  A C J )  AND  IN  THE  CONTEXT  OF  THE  PATTERN  POO  1$ 
THE  STRING  OF  NL  WORDS  NL<L>. 

B)  FL  COMPLEX  =  FL  ( I  >  >  PATTERNS  ( J ) ,  NL  STRING=NL(K) 

TO  BE  INTERPRETED!  THE  TRANSLATION  OF  THE  FU  COMPLEX  FLU)  IN  THE 
CONTEXT  OF  THE  PATTERN  P(J)  IS  THE  STRING  NIMK)  IN  NL. 

NOTE  THAT  WE  CANNOT  CONCLUDE  THAT  SOME  FL  UNIT  FLU)  HAS  A 
TRANSLATION  IN  THE  CONTEXT  A(J),  P{«>  FROM  THE  KNOWLEDGE  THAT 
FLU)  IS  A  MEMBER  OF  A(J),  WE  MAY  HAVE  A  TRANSLATION  IN  THE 
CONTEXT  OF  SOME  OTHER  PATTERN  P(K'),  OR,  FOR  THAT  MATTER,  NONE  AT 
ALL. 


-18 


C.  THE  PROGRAM'S  ORGANIZATION. 


THE  CONTROL  STRUCTURE  OF  ZBIE  CONSISTS  OF  TWO  MODES.  THERE 
IS  FIRST  AN  INITIALIZATION  OF  THE  INTERNAL  STRUCTURE*  WHEN  A 
FIRST  PATTERN  IS  CONSTRUCTED.  THE  CONTROL  THEN  PASSES  TO  A  SECOND 
MODE  WHEN  SITUATIONS  ARE  3ROUGHT  IN  ONE  BY  ONE  AND  PROCESSED. 

MODE  1.  INITIALIZATION. 

TWO  SITUATIONS  ARE  PRESENTED  TO  ZBIE.  REPRESENTED  IN  FL  AND 
EXPRESSED  IN  NL.  THE  SITUATIONS  MUST  BE  SUFFICIENTLY  SIMILAR*  SO 
THAT  BY  COMPARING  THEM  ZBIE  CAN  DEDUCE  ITS  FIRST  PATTERN. 

MORE  PRECISELY.  ZBIE  EXPECTS!  THAT  THE  TWO  Fl  SENTENCES  WILL 
BE  OF  DEPTH  0.  I.E.  HAVE  NO  Fl  COMPLEX  SUBSTRUCTURE  I  THAT  THEY 

will  have  exactly  one  element  different  and  in  the  same  position) 

AND  THAT  THE  TWO  CORRESPONDING  NL  SENTENCES  WILL  HAVE  EXACTLY  ONE 
ELEMENT  DIFFERENT  AND  IN  THE  SAME  POSITION,  WHICH  MUST  BE  AT  THE 
BEGINNING  OR  AT  THE  END  OF  (EITHER)  NL  SENTENCE.  THE  DISTINCT 
ELEMENTS  IN  FL  AND  NL  ARE  THEN  ASSUMED  TO  CORRESPOND  TO  EACH 
OTHER)  THE  COMMON  PARTS  IN  FL  AND  NL  ARE  ALSO  ASSUMED  TO 
CORRESPOND  TO  EACH  OTHER  AND  A  FIRST  PATTERN  PO  IS  SET  UP,  WITH 
ITS  SETS  AND  TRANSLATION  RULE)  THE  IN-CONTEXT  VOCABULARY  IS 


INITIATED, 
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MODE  2.  SINGLE  SENTENCE  ANALYSIS. 

AFTER  INITIALIZATION,  7BIE  OPERATES  IN  THE  FOLLOWING  MODE. 
FIRST.  THE  PREVIOUSLY  PROCESSED  FL  AND  NL  SENTENCES  ARE  ERASED. 
THEN,  THE  DESCRIPTION  IN  FL  OF  A  SITUATION  IS  READ  IN,  TOGETHER 
WITH  ITS  EXPRESSION  IN  NL  WHICH  IS  STORED  FOR  LATER  USE.  THE  Fl 
SENTENCE  IS  THEN  PROCESSED  FOLLOWING  THE  BASIC  FLOW  CHART  8ElOW 
(WRITTEN  IN  AN  ALGOL-LIKE  LANGUAGE,  »<•  AND  »>»  DELIMIT  BLOCKS)! 

SINGLE  SENTENCE  PROCESSOR. 

FOR  ALL  TOP  PATTERNS  (LAST  CREATED,  FIRST  CONSIDERED)  DO 
<MATCH  FL  TO  TOP  PATTERN) 

COMMENT!  THE  MATCHING  ROUTINE  IS  DESCRIBED  IN  PART  1  BELOW) 

IF  TOTAL  MATCH  THEN 
TRANSLATE) 

IF  TRANSLATION  HAS  NO  UNKNOWNS  THEN  <COmPaRE  TO  INPUT  NL) 

IF  TRANSLATION  a  INPUT  NL  THEN  <EXlT  AND  READ  IN  THE  NeXT 
SITUATION)-  ELSE  GO  TO  ERROR  RECOVERY> 

ELSE  IF  TRANSLATION  IS  CONSISTENT  WITH  INPUT  NL  THEN  STORE 
PATTERN  LIST  IN  PATTERN  LIST  HOLDER  To  PROCESS  ELSE  DO 
NOTH  I NG> 

COMMENT!  THE  CONSISTENCY  TEST  IS  DESCRIBED  IN  PART  2) 

ELSE  STORE  PATTERN  LIST  IN  PATTERN  LIST  HOLDER> 

PROCESS  ELEMENTS  ON  THE  PATTERN  LIST  HOLDER 

COMMENT!  PROCESSING  THE  PATTERN  LISTS  IS  DESCRIBED  IN  PART  3) 

< I F  PROCESSING  SUCCESSFUL  THEN  <EXlT  AND  READ  IN  THE  NEXT 
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SITUATIONS 

COMMENT  r  EVERYTHING  FAILED  SO  FAR  I 
CREATE  A  NEW  TOP  PATTERN  FOR  THE  SITUATION. 

COMMENTI  THE  PATTERN  CREATING  ROUTINE  19  DESCRIBED  IN  PART  4) 

BEFORE  DESCRIBING  HOW  THE  PATTERN  LISTS  ARE  PROCESSED.  LET 
US  EXPLAIN  SOME  OF  THE  TERMS  USED. 

WE  SAW  IN  CHAPTER  II,  PART  3  HOW  AN  FL  SENTENCE  WAS  MATCHED 
TO  A  PATTERN.  ONE  OF  THE  MAIN  ROUTINES  OF  ZB  I E  IS  THE  MATCHING 
ROUTINE,  WHICH  OBTAINS  ALL  POSSIBLE  TOTAL  AND  PARTIAL  MATCHES  OF 
PATTERNS  (AND  SUBPATTERNS)  TO  AN  FL  SENTENCE.  LET  US  CONSIDER  THE 
MATCHING  MECHANISM  AGAIN. 

PART  1  -  THE  MATCHING  ROUTINE. 

AN  FL  SENTENCE  IS  A  TREE  STRUCTURE)  THE  TERMINAL  NODES  ARE 
THE  FL  UNITS.  THE  SETS  OF  THE  P-LlST  OF  A  TOP  PATTERN  CAN  BE 
VIEWED  AS  THE  ZERO-TH  LEVEL  OF  A  TREE,  THE  PATTERN  TREE.  THE  SETS 
THEMSELVES  CAN  CONTAIN  ( SUB ) PATTERNS)  WE  CaN  THINK  OF  EACH 
SUBPATTERN  AS  INITIATING  A  NEW  BRANCH  OF  THE  PATTERN  TREE.  AN 
INSTANCE  OF  A  SET  WILL  BE  CONSIDERED  AS  A  TERMINAL  NODE  OF  THE 
PATTERN  TREE  IF  WE  SELECT  AN  FL  UNIT  OF  THE  SET.  IF  WE  SELECT  A 
SUBPATTERN  OF  THE  SET,  THE  INSTANCE  OF  THE  SET  WILL  BE  CONSIDERED 
AS  A  NON-TERMINAL  NODE,  AND  THE  SUBPATTERN  WILL  INITIATE  A  NEW 
SUBTREE.  SINCE  A  SUBPATTERN  SPi  MAY  HAVE  ON  ITS  P-LIST  THE  NAME 
OF  A  SET  WHICH  CONTAINS  A  (SUB)PATTERN  P2  SUCH  THAT  P2  IS  AN 
ANCESTOR  OF  SPi,  A  TOP  PATTERN  CAN  BE  CONSIDERED  AS  THE  HEAD  OF 


-21- 


AN  INFINITY  OF  TREES  OF  ARBITRARILY  LARQE  DEPTH,  HOWEVER#  SINCE 
ANY  FL  SENTENCE  IS  A  FINITE  TREE,  NO  PATTERN  TREES  OF  A  DEPTH 
SUPERIOR  TO  THE  DEPTH  OF  THE  FL  SENTENCE  NEED  BE  CONSIDERED. 

THE  PATTERN  TREES  FORMED  BY  THE  PATTERNS  RESEMBLE  A 
DISCRIMINATION  NET.  A  NET  OF  DEPTH  N  CANNOT  DISTINGUISH  BETWEEN 
TWO  TREES  OF  DEPTH  LARGER  THAN  N  WHICH  ARE  IDENTICAL  UP  TO  AND 
INCLUDING  DEPTH  N.  HOWEVER,  IN  SOME  CASES,  N  DIFFERENT  PATTERNS 
COULD  DISTINGUISH  TWO  SUCH  TREES  THANKS  TO  THE  RECURSIVE  FEATURE 
OF  THE  PATTERNS.  THE  PATTERN  TREES  ARE.  THEREFORE#  MORE  POWERFUL 
THAN  A  SIMPLE  DISCRIMINATION  NET. 

WE  CAN  VIEW  THE  MATCHING  PROCESS  AS  A  TEST  OF  WHETHER  A 
PATTERN  TREE  IS  CLOSE  TO  BEING  ISOMORPHIC  TO  THE  FL  SENTENCE 
TREE.  AN  FL  SENTENCE  TREE  IS  ISOMORPHIC  TO  A  PATTERN  TREE  IF  THE 
TREES  CAN  BE  SUPERIMPOSED,  AND  THE  TERMINAL  NODES  (FL  UNITS)  OF 
THE  FL  SENTENCE  ARE  RESPECTIVELY  IDENTICAL  TO  THE  TERMINAL  NODES 
(FL  UNITS  OF  TERMINAL  SETS)  OF  THE  PATTERN  TREE.  USUALLY  WE  SHALL 
HAVE  NO  ISOMORPHISM)  WE  THEN  LOOK  FOR  AS  GOOD  A  FIT  OF  A  PATTERN 
TREE  TO  THE  FL  SENTENCE  AS  WE  CAN  FIND. 

DISREGARDING  THE  BOOKKEEPING  CHORES  INVOLVED  IN  BACKTRACKING 
AND  RECURSION#  IT  IS  ENOUGH  TO  CONSIDER  HOW  AN  FL  SUBTREE  IS 
MATCHED  TO  AN  ELEMENT  OF  A  SET,  NODE  OF  THE  PATTERN  TREE.  BY 
CONSIDERING  THE  TOP  PATTERNS  AS  ELEMENTS  OF  A  SET,  NO  GENERALITY 
IS  LOST.  WE  TREAT  THE  SPECIAL  CASE  OF  AN  EMPTY  SET  BY  POSTULATING 
AN  EMPTY  ELEMENT  FOR  SUCH  A  SET. 
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PART  1.1  -  OUTLINE  OF  THE  MATCHING  ROUTINE. 

MATCH  FL  (SUB)TREE  TO  ELEMENT  OF  SET! 

COMMENT!  QUICK  EXITS/ 

ELSET  !*  ELEMENT  OF  SET! 

FLTREE!*  FL  SUBTREE! 

(IF  ELSET  IS  AN  FL  WHOLE  OR  IF  ELSET  IS  EMPTY)  THEN  <*NQ  MATCH’! 
GO  TO  EXI T>! 

COMMENT!  ELSET  IS  A  < SUB ) PATTERN! 

IF  LENGTH  (P-LIST  OF  ELSET)  «=  2  *  LENGTH  OF  FLTREE 
THEN  <’NO  MATCH*!  GO  TO  EXlT>! 

COMMENT!  INITIALIZE  LOOP! 

MISTAKE  COUNTER  I  s  0! 

COMMENT!  THE  MISTAKE  COJNTER  IS  ASSOCIATED  WITH  THIS  PARTICULAR 
LEVEL.  AS  ARE  THE  OTHER  IDENTIFIERS! 

I  I3  0! 

LOOP! 

IF  MISTAKE  COUNTER  >  1  THEN  <»NO  MATCH'!  GO  TO  EXIT>; 

I  I3  I+1! 

IF  I-TH  SON  OF  FLTREE  DOES  NOT  EXIST  THEN  GO  TO  EXIT! 

IFLTREE  (a  I-TH  SON  OF  FLTREE! 

I ELSET  ! a  I-TH  SET  OF  P-.IST  OF  ELSET! 

IF  IFLTREE  IS  AN  FL  WHOLE  THEN 

< I F  IFLTREE  IS  A  MEMBER  OF  I ELSET  THEN 


GO  TO  LOOP 
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ELSE  <MISTAKE  COUNTER  Is  MISTAKE  COUNTER  ♦  U  GO  TO  LOOP>> 
ELSE  <MATCH  I FLTREE  TO  THE  ELEMENTS  OF  IELSET) 

COMMENT!  THE  MATCH  IS  TRIED  SUCCESSIVELY  CN  ALL  THE  ELEMENTS  OF 
I SLSET .  THANKS  TO  THE  HIDDEN  BOOKKEEPING,  WE  ONLY  HAVE  TO 
CONSIDER  THE  HATCH  FOR  ONE  ELEMENT! 

IF  RETURN  *  NO  MATCH*  THEN 

<MISTAKE  COUNTER  1=  MISTAKE  COUNTER  +  l!  GO  TO  LOOP> 

ELSE  GO  TO  LOOP> 

IT  IS  SEEN  THAT,  BASICALLY*  UP  TO  ONE  ’MISTAKE*  (AS  DEFINED 
BY  THE  PROGRAM)  IS  ALLOWED  AT  A  GIVEN  LEVEL  IN  A  SUBTREE. 

PART  1,2  -  USE  OF  THE  MATCHING  ROUTINE. 

THE  MATCHING  ROUTINE  FINDS  PATTERN  LISTS,  WHICH  IT  STORES  IN 
A  PATTERN  LIST  HOLDER  IN  DECREASING  ORDER  OF  MATCH-DEPTH.  A 
PATTERN  LIST  IS  A  LIST  O*  PATTERNS.  HEADED  BY  A  TOP  PATTERN  AND 
CONTAINING  OTHER  (OR  POSSIBLY  NO)  SUBPATTERNS  WHICH  WERE  MATCHED 
TO  SUBSTRUCTURES  OF  THE  FL  SENTENCE.  WITH  THE  PATTERN  LIST  IS 
ASSOCIATED  A  CORRESPONDING  LIST  OF  FL  COMPLEX  STRUCTURES  IN 
ONE-TO-ONE  CORRESPONDENCE  WITH  THE  SUBPATTERNS  THEY  MATCHED.  THE 
MATCHING  ROUTINE  ALSO  RECORDS  THE  DEEPEST  LEVEL  IN  THE  FL 
SENTENCE  TO  WHICH  THE  MATCH  WAS  CARRIED,  THE  MATCH-DEPTH*  AND 
WHETHER  THE  MATCH  WAS  TOTAL  OR  oarTIAL.  A  MATCH  IS  PARTIAL  IF  AT 
ANY  POINT*  DURING  THE  MATCH  OF  A  PATTERN  TREE  TO  THE  FL  SENTENCE, 
A  MISTAKE  COUNTER  WAS  INCREMENTED.  THE  match-depth  is  A  measure 
OF  HOW  GOOD  THE  MATCH  OF  THE  Fl  SENTENCE  TO  THE  PATTERN  LIST  HAS 
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BEEN,  AND  Z8IE  LOOKS  AT  THE  BEST  MATCHES  FIRST. 

WHEN  THE  TRANSLATION  OF  A  PATTERN  LIST  IS  ATTEMPTED,  IT  MAY 
HAPPEN  THAT  SOME  FL  STRUCTURE  CANNOT  BE  TRANSLATED.  FOR  EXAMPLE, 
THE  STRUCTURE  MAY  BE  AN  FL  UNIT  WITH  NO  TRANSLATION  IN  THE 
CONTEXT  CONSIDERED,  OR  IT  IS  AN  FL  COMPLEX  PART  WHICH,  FOR  THE 
PARTICULAR  PATTERN  LIST  CONSIDERED,  HAS  NO  CORRESPONDING 
SU8PATTERN  TO  WHICH  IT  WAS  MATCHED.  WE  THEN  INSERT  A  Z  <Z0,  Zl» 
Z2,  IN  THE  TRANSLATION.  THE  Z  IS  CONSIDERED  BY  ZBIE  TO  BE 
THE  RESULT  OF  AN  UNFULFILLED  EX°ECTAT I  ON,  AND  ZB  I E  CAPITALIZES  ON 
THESE  EXPECTATIONS  FOR  LEARNING.  7BIE  CHECKS  WHETHER  THE 
TRANSLATION  OBTAINED  IS  CONSISTENT  WITH  THE  INPUT  NL  SENTENCE- 

PART  2  -  THE  CONSISTENCY  TEST, 

WH  CAN  IMAGINE  THAT  THE  TRANSLATION  AND  THE  INPUT  NL 
SENTENCE  ARE  PUT  SIDE  BY  SIDE.  WE  SHALL  HAVE  CONSISTENCY  IF  WE 
CAN  REPLACE  THE  Z’S  OF  THE  TRANSLATION  BY  NON-EMPTY  STRINGS  IN  NL 
IN  A  UNIQUE  NON-AMBIGUOUS  WAY  SO  THAT  THE  TRANSLATION  BECOMES 
IDENTICAL  TO  THE  INPUT.  WHETHER  THIS  CAN  BE  DONE  OR  NOT  IS  OFTEN 
TRIVIAL  IF  NO  TWO  Z'S  ARE  ADJACENT.  WHEN  TWO  OR  MORE  Z'S  ARE 
ADJACENT,  Z8IE  DOES  NOT  GIVE  UP  BUT  REPLACES  THE  FIRST  Z  BY  AN 
APPROPRIATE  GOOD  GUESS  (IF  AVAILABLE,  SEE  BELOW).  THE  VARIOUS 
GUESSES  THAT  WILL  BE  TRIED  ARE  PRINTED.  IF  PROGRESS  IS  MADE 
TOWARDS  CONSISTENCY,  THE  GUESS  IS  ADOPTED  <WE  DO  NOT  HAVE 
COMPLETE  BACKTRACKING  HERE),  AND  WE  CONTINUE.  OTHERWISE,  GUESSES 
ARE  TRIED  FOR  THE  SECOND  Z.  IF  THIS  LAST  RESORT  FAILS,  THE 
TRANSLATION  AND  THE  INPUT  NL  SENTENCE  ARE  NOT  CONSISTENT. 
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HSRE  WE  SEE  AN  EXAMPLE  OF  THE  CAUTION  ZBIE  USES  IN  LEARNlNO. 
IF  WE  WANT  Z  Z1  TO  CORRESPOND  TO  THE  NL  STRING  NLi  NL2  NL3,  W£ 
CAN  MAKE  THE  CORRESPONDENCE  IN  TWO  WAYS  (THE  Z'S  MUST  BE  MATCHED 
TO  NON-EMPTY  STRINGS  IN  NLM 
Z*Nli,  Z1*NL2  NL3) 

Z«*NL1  NL2,  Z1-NL3I 

HOWEVER,  IF  IT  IS  A  GOOD  GUESS  TO  ASSUME  THAT  Z*-NLl,  THEN  W£  CAN 
LET  Z1-NL2  NL3. 

AN  EXAMPLE  FROM  CHAPTER  III  (SENTENCE  4)  WILL  ILLUSTRATE  THE 
POINT.  WE  ARE  TESTING  THE  CONSISTENCY  OF  <Z  Zl)  AND  <  T 1 2  ZDESi>. 
(Z  Zl)  IS  THE  TRANSLATION  OF  (8E  (SPOKEN  80Y>  HERE).  *Z»  COmES 
FROM  THE  UNKNOWN  TRANSLATION  OF  (SPOKEN  BOY)  AND  *71'  FROM  THE 
UNKNOWN  TRANSLATION  OF  'WERE'.  WITH  NO  ADDITIONAL  INFORMATION, 
ZB  I E  REFUSES  TO  MAKE  A  CORRESPONDENCE  BETWEEN  THE  Z'S  AND  THE  NL 
WORDS.  AND  WOULD  FIND  THE  SENTENCE  'TOO  HARD'.  (STRICTLY,  WE 
SHOULD  LET  Z-TI2,  Zl-ZOESl  AS  7’S  CORRESPOND  TO  NON-EMPTY 
STRINGS,  BUT  ZB  I E  IS  EVEN  MORE  CAUTIOUS.)  HOWEVER,  It  IS  A  'GqOD 
GUESS'.  IN  THIS  CONTEXT.  TO  ASSUME  THAT  THE  TRANSLATION  OF  'HERE* 
IS  'ZDES1S  SO  THAT,  AS  A  RESULT,  Z*TI?. 

IF  SOME  PATTERN  LIST  COMPLETELY  MATCHES  AN  FL  SENTENCE  AND 
WE  OBTAIN  A  TOTAL  TRANSLATION  (WITHOUT  ANY  Z'S)  WHICH  IS  NOT 
IDENTICAL  TO  THE  INPUT  NL,  SEVERAL  POSSIBILITIES  ARISE: 

1)  THERE  WAS  A  MISTAKE  IN  THE  INPUT  (THAT  HAS  HAPPENED). 

2)  THE  TRANSLATION  AND  THE  INPUT  ARE  TWO  DIFFERENT  WAYS  OF 
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EXPRESSING  THE  SAME  SITUATION.  HERE  A  TEACHER  UND  PREFERABLY  A 
TIME  SHARING  SITUATION)  IS  NEEDED  TO  CONVEY  THE  INFORMATION  TO 
ZBIE, 

3)  Z8IE  MADE  SOME  ERROR  SOMEWHERE  AND  SHOULD  TRY  TO  RECOVER  FROM 
THIS  ERROR.  GOOD  ERROR  RECOVERY  IS  A  VERY  HARD  PROBLEM  WHICH  WILL 
BE  MENTIONED  LATER.  AT  THIS  STAGE.  ZB  I E  POSSESSES  NO  ERROR 
RECOVERY  MECHANISM.  IT  WAS  FELT  THAT  TRYING  TO  AVOID  ERRORS  IS  A 
MORE  FRUITFUL  APPROACH  THAN  TRYING  TO  RECOVER  FROM  THEM.  THg 
ERROR  AVOIDING  MECHANISM  IS  POWERFUL  ENOUGH  SO  THAT  ZBIE  ACTUALLY 
MAKES  NO  ERRORS  WHEN  TESTED  ON  THE  SIMPLE  SENTENCES  GIVEN  AS 
EXAMPLES. 


PART  3  -  PROCESSING  THE  PATTERN  LISTS. 

WE  NOW  RETURN  TO  THE  BASIC  FLOW-CHART.  THE  PROCESSING  IS 
SLIGHTLY  DIFFERENT  FOR  FL  SENTENCES  WITH  FL  COMPLEX  PARTS  THAN 
FOR  LINEAR  FL  SENTENCES  (OF  DEPTH  0).  LET  US  DESCRIBE  PROCESSING 
THE  FORMER  SENTENCES. 

PART  3,1  -  PATTERN  LISTS  OF  FL  SENTENCES  WITH  COMPLEX  PARTS. 
COMMENT  »  PROCESS  PATTERN  LISTS) 

FOR  ALL  PATTERN  LISTS  OF  THE  DEEPEST  LEVEL  (THEN  DEEPEST  LEVEL  - 
1,  ETC...)  DO 

CTRANSLATE  PATTERN  LISTS) 

KEEP  ONLY  PATTERN  LISTS  WHICH  HAVE  A  TRANSLATION  CONSISTENT 
WITH  THE  INPUT  NL) 

PROCESS  PATTERN  LISTS  WITH  CONSISTENT  TRANSLATION,  STARTING 
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WITH  THE  PATTERN  LISTS  THAT  HAVE  A  TRANSLATION  WITH  THE 
GREATEST  NUMBER  OF  COMMON  ELEMENTS  WITH  THE  INPUT  NL  SENTENCE> 

IN  OTHER  WORDS,  ZB  I E  DOES  A  TRANSLATION  »IN  PARALLEL*  OF  ALL 
PATTERN  LISTS  THAT  MATCHED  THE  INPUT  FL  SENTENCE  TO  A  GIVEN 
DEPTH,  STARTING  WITH  THE  MAylMUM  DEPTH  (BEST  MATCHES)  FIRST.  ZB  I E 
THEN  DISCARDS  THE  PATTERN  LISTS  WHICH  DID  NOT  GIVE  A  CONSISTENT 
TRANSLATION  AND  STARTS  PROCESSING  THE  PATTERN  LISTS  WITH  THE  BEST 
FIT  TO  THE  INPUT,  AS  MEASURED  BY  A  SET  INTERSECTION  WITH  THE 
INPUT  NL  SENTENCE. 

3 o 1 . 1  -  PROCESSING  THE  Z'S. 

PROCESSING  SUCH  A  TRANSLATION  IS  EQUIVALENT  TO  PROCESSING 
THE  Z*S.  EACH  Z  TAKES  THE  PLACE  OF  SOME  UNTRANSLATED  FL  STRUCTURE 
FLZ  AND,  THROUGH  THE  CONSISTENCY  TEST  (PART  2  ABOVE),  THE  Z  IS  TO 
BE  REPLACED  BY  A  NON-EMPTY  NL  STRING  NL7 .  FROM  THE  Z  WE  CAN  ALSO 
OBTAIN  INFORMATION  SUCH  A  5  *  TO  WHICH  SET,  AZ,  DID  WE  TRY  TO  MATCH 
FLZ I  WHICH  WAS  THE  PATTERN,  PZ,  TO  WHICH  THE  FATHER  OF  FLZ  (IN 
THE  FL  SENTENCE  TREE)  WAS  8EING  MATCHED. 

IF  FLZ  IS  A  UNIT,  WE  INSERT  FLZ  IN  A7  AND  SET  UP  TH£ 
IN-CONTEXT  VOCABULARY  FLZ  AZ  PZ  NLZ , 

IF  FLZ  IS  A  COMPLEX  Fl,  WE  TRY  TO  CREATE  A  LIST  OF 
SUBPATTERNS  TO  MATCH  FLZ  TO  NLZ  (SEE  BELOW).  IF  SUCCESSFUL,  WE 
WOULD  LIKE  TO  INSERT  THE  TOP  SUBPATTERN  OF  THE  L I  ST  AT  THE  TOP  OF 
AZ. 
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BEFORE  INSERTING,  W=  CHECK  TO  MAKE  SURE  THAT  THE  SURPATTgRN 
LIST  WILL  NOT  CAUSE  AMBIGUITIES.  THIS  CAN  HAPPEN  IP  THERE  IS 
ALREADY  IN  AZ  A  SUBPATTERN  LIST  SPl  OP  WHICH  THE  NEW  SUBPATTERN 
LIST  SP2  IS  A  HOMOMORPHIC  IMAGE,  I.E.  SETS  OP  SP?  ARE  SUBSETS  OP 
THE  CORRESPONDING  SETS  OF  SPl  AND  THE  TRANSLATIONS  OP  THE 
SUBPATTERNS  IN  SPl  AND  SP2  ARE  APPROPRIATELY  IDENTICAL.  IP  SUCH  A 
CONDITION  IS  SATISFIED  (WITH  SOME  MINOR  ADDITIONS),  NO  INSERTION 
TAKES  PLACE,  'NOT  INSERTED*  IS  PRINTED.  AND  PROCESSING  OF  THE 
PATTERN  LIST  IS  ENDED. 

IP  AN  PL  COMPLEX  PART  IS  TO  BE  MATCHED  TO  A  SET,  THE 
BACK-TRACKING  MATCHING  ROUTINE  WILL  SEARCH  FOR  ALL  THE 
SUBPATTERNS  (OF  THE  SET)  THAT  WILL  MATCH  THE  PL  COMPLFX  PART.  IP 
TWO  SUBPATTERNS  CAN  TRANSLATE  THE  PL  COMPLEX  PART  (IN  DIFFERENT 
WAYS),  THEN  A  POTENTIAL  AMBIGUITY  IS  INTRODUCED  IN  THE  SYSTEM. 
EXAMPLE*  IN  CHAPTER  III,  SENTENCE  ?7,  THE  FL  COMPLEX  [MOD  THIS) 

is  translated  as  •  E2tot «  8r  subpattern  p33  and  as  'E2Ta*  by 

SUBPATTERN  P32.  THE  TWO  SUBPATTERNS  WILL  CAUSE  AMBIGUITY  IF  THEY 
BELONG  TO  THE  SAME  SET. 

HERE  IS  ANOTHER  EXAMPLE  OF  HOW  ZRlE  TRIES  TO  AVOID  ERRORS 
THE  CONTEXT  IN  WHICH  THE  SUBPATTERNS  WERE  ORIGINALLY  BUILT  WAS 
TOO  SMALL,  AND  POSSIBLY  LATER,  BY  WIDENING  THE  CONTEXT, 
SUBPATTERNS  CAN  BE  BUILT  WITHOUT  RISKING  AMBIGUITIES  AT  A  LATER 
TIME. 


NOTE  THAT  WE  INSERT  THE  HEAD  OF  A  SUBPATTErN  LIST  AT  THE  TOP 
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QF  Az  SO  THAT  IF  THE  SAME  FL  SENTENCE  IS  PRESENTED  ONCE  MORE 
IMMEDIATELY  AFTERWARDS,  IT  WILL  BE  MATCHED  WITHOUT  ANY 
BACKTRACKING  USING  THE  SUSP  ATTERN  <  S )  JIJST  CREATED, 

PART  3.2  -  PATTERN  LISTS  OF  LINEAR  Fl  SENTENCES. 

WHEN  PROCESSING  LINEAR  FL  SENTENCES,  WE  ARE  ONLY  CONCERNED 
WITH  TOP  PATTERNS.  PROCESSING  ALL  TOP  PATTERNS  WHICH  GAVE  A 
PARTIAL  MATCH  WOULD  BE  WASTEFUL,  SO  WE  PROCESS  THEM  AS  A  STACK; 
LAST  CREATED,  FIRST  CONSIDERED.  HOWEVER  IF  A  PATTERN  IS  FIRST 
CONSIDERED,  AND  ITS  TRANSLATION  IS  JUST  Z  (NOTHING  IN  NL)>  THEN 
•WAIT'  IS  PRINTED  AND  THE  PATTERN  IS  INSERTED  AT  THE  BOTTOM  OF 
THE  STACK  FQR  RECONSIDERATION  LATER,  IF  NECESSARY.  WE  DO  THIS 
BECAUSE  WE  MAY  WELL  FIND  ANOTHER  PATTERN  WITH  A  TRANSLATION  THAT 
CONTAINS  SOME  NL  ELEMENTS  AND  IS  CONSISTENT  WITH  THE  INPUT. 

PART  3.2.1  -  MATCH-BACK. 

THE  MAJOR  DIFFERENCE  IN  PROCESSING  LINEAR  OR  NON-LINEAR  Fl 
SENTENCES  IS  THAT  IF  WE  UPDATE  THE  VOCARULARY  BY  TRANSLATING  AN 
FL  COMPLEX  PART  IN  THE  CONTEXT  OF  A  PATTERN  ONLY,  I.E.  THE 
TRANSLATION  RULE  OF  THE  PATTERN  WAS  OF  TYPE  C  <  S E E  ABOVE,  CHAPTER 
I  I  -  B  )  ,  THEN  WE  TRY  TO  SPLIT  THE  TRANSLATION  USING  EXACTLY  THE 
SAME  ROUTINES  THAT  WERE  USED  FOR  THF  INITIALIZATION  OF  THE 
SYSTEM.  IF  SUCCESSFUL.  WE  CREATE  A  NEW  PATTERN  WHICH  WILL  HaVE 
THE  SAME  SETS  AND  EXTRACTORS  AS  THE  PATTERN  CONSIDERED,  BUT  WHICH 
WILL  HAVE  A  DIFFERENT  (AND  SIMPLER)  TRANSLATION  RULE.  WE  CALL 
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TH I s  PROCESS  match-back.  for  an  example,  see  CHAPTER  hi, 
SENTENCE  3)  PATTERN  Pi  !S  OBTAINED  FROM  PATTERN  Po  BY  MATCH-BACK. 

SINCE  WE  TRY  TO  MATCH  AN  FL  SENTENCE  TO  PATTERNS  IN  THE 
REVERSE  ORDER  IN  WHICH  THEY  WERE  CREATED  (LAST  PATTERN  CREATED, 
FIRST  TRIED),  AN  FL  SENTENCE  CAN  BE  MATCHED  AND  TRANSLATED  8y  A 
PATTERN  (OBTAINED  BY  MATCH-BACK)  WHICH  IS  NEWER  THAN  THE  PATTERN 
THAT  WOULD  OTHERWISE  HAVE  MATCHSO  THE  FL  SENTENCE.  AS  A  RESULT, 
IT  CAN  HAPPEN  THAT,  EFFECTIVELY,  SOME  OF  THE  OLDER  PATTERNS  ARE 
NEVER  REACHED  ANY  MORE.  THIS  RESULT  CAN  BE  BENEFICIAL  AS  SOME  OF 
THE  EARLIER  PATTERNS  MAY  HAVE  INCORPORATED  MISTAKES  WHICH, 
THEREFORE,  WILL  NOT  BE  MADE  ANY  MORE.  WE  HAVE  HERE  A  RATHER 
ELEMENTARY  EXAMPLE  OF  WHAT  MAY  BE  CALLED  'EVOLUTIONARY  LEARNING'. 

an  example  in  german  appears  in  appendix  b. 

PART  3.2.2  -  'TRY  LEARN  MORE'. 

IF  A  LINEAR  FL  SENTENCE  HAS  BEEN  TRANSLATED  BY  A  PATTERN  PI, 
AND  IF  THE  SENTENCE  WAS  COMPLETELY  MATCHED  BY  SOME  OTHER  PATTERN 
PJ  WHICH  HAD  BEEN  CREATED  AFTER  PI,  THEN  ZBlE  TAKES  THE  FIRST 
SUCH  PATTERN  PJ  THAT  WAS  CONSIDERED  AND  TRIES  TO  LEARN  FROM  PJ, 
AS  IF  THE  SENTENCE  HAD  NOT  BEEN  TRANSLATED.  ZBIE  PRINTS  'TRY 
LEARN  MORE'  WHEN  SUCH  A  CASE  OCCURS.  IT  IS  THE  SIMPLE  'TRY  LEaRN 
MORE'  PROCESS  WHICH  MAKES  'EVOLUTIONARY  LEARNING'  P0SSI8LE.  WE 
ONLY  USE  THIS  PROCESS  FOR  LINEAR  FL  SENTENCES.  FOR  COMPLEX  FL 
SENTENCES#  CONTEXT  IS  ESSENTIAL,  AND  THE  CONTEXT  EXISTS  MORE  AT 
THE  LEVEL  OF  THE  IN-CONTSXT  TRANSLATION  THAN  AT  THE  LEVEL  OF  THE 
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SET  INCLUSION  TEST5 . 

PART  4  -  THE  PATTERN  CREATING  ROUTINE. 

FINALLY.  WE  MUST  CONSIDER  ANOTHER  VERY  IMPORT  ANT  ROUTINE  IN 
2816*  THE  PATTERN  CREATING  ROUTINE.  DEPENDING  ON  AN  INPUT 
PARAMETER.  THIS  ROUTINE  CREATES  A  TOP  PATTERN  OR  A  SUBPATTERN. 
WE  SAW  ABOVE  HOW  THE  NEED  FOR  NEW  SUBPATTERNS  ARISES.  Zg  I E 
ATTEMPTS  TO  CREATE  A  TOP  PATTERN  WHEN  ALL  PREVIOUSLY  DESCRIBED 
PROCESSING  HAS  FAILED. 

THE  PATTERN  GREAT  I N 3  ROUTINE  IS  ONE  OF  THE  LONGEST  AND  MOST 
COMPLICATED  IN  THE  SYSTEM.  ONLY  ITS  MAIN  PARTS  WILL  BE  DESCRIBED. 
IT  TRIES  TO  CREATE  A  LIST  OF  PATTERNS  WHICH  WILL  MATCH  THE  INPUT 
FL  COMPLEX  STRUCTURE  FLI  TOTALLY  AND  GIVE  AS  A  TRANSLATION  (AFTER 
SUCH  A  MATCH)  THE  INPUT  NL  STRING  NLl,  MAKING  USE  OF  ALREADY 
KNOWN  INFORMATION. 

THE  ROUTINE  MAKES  FROM  ONE  TO  FOUR  PASSES  ON  FLI.  EACH  PaSS 
IS  FIRST  PERFORMED  ON  ALL  APPROPRIATE  ELEMENTS  OF  FLI  BEFORE  THE 
NEXT  PASS  IS  BEGUN.  THE  MAIN  FEATURES  OF  EACH  PASS  ARE : 

PART  4.1  -  OUTLINE  OF  PATTERN  CREATING  ROUTINE. 

1)  FIND  WHETHER  AN  FL  UNIT  (NOT  A  VERB)  IN  FLI  HAS  A  TRANSLATION 
(IN  SOME  CONTEXT  A,  P)  WHICH  IS  FOUND  EXACTLY  IN  ML  I .  IF  THAT  IS 
THE  CASE.  AND  FINALLY  THE  PATTERNS  ARE  CREATED.  THEN  THE  SAME  SET 
A  WILL  BE  USED  IN  SAY  SOME  ( SUB ) PATTERN  PJ,  AND  ON  THE  SET  A  WE 
PUT  THE  INFORMATION:  IF  WE  WANT  THE  TRANSLATION  OF  AN  ELEMENT  IN 
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A  IN  THE  CONTEXT  P,  IT  IS  A  GOOD  GUESS  TO  ASSUME  THAT  THE 
TRANSLATION  IS  THE  SAME  AS  IN  THE  CONTEXT  A,  pJ  AND  VICE-VERSA. 
THIS  IS  A  CASE  OF  THE  'GOOD  GUESS'  MENTIONED  WHEN  DISCUSSING  THE 
CONSISTENCY  OF  A  TRANSLATION  WITH  AN  NL  SENTENCE. 

2)  FIND  WHETHER  AN  FL  WHOLE  (NOT  A  VERB)  IN  FLl  HAS  A  TRANSLATION 
WHICH  'LOOKS  LIKE*  SOME  STRING  IN  NL I .  A  TEST  FOR  SUCH  A 


SIMILARITY 

IS  MADE  USING 

THE  FIRST 

FEW 

CHARACTERS  OF 

THE 

PRINT 

NAMES  OF 

THE  TRANSLATION 

AND  OF 

THE 

elements  in 

NLI. 

FOR 

INSTANCE. 

IN  RUSSIAN,  THE 

GENITIVE 

OF 

BOY  LOOKS 

LIKE 

THE 

NOMINATIVE  OF  BOY,  (REMEMBER  THAT,  BECAUSE  OF  THE  Fl  STATEMENT, 
WE  EXPECT  SOMETHING  WHICH  HAS  TO  DO  WITH  '8QY').  SUCH  A  TEST 
WOULD  HAVE  TO  BE  IMPROVED  TO  WORK  FOR  LANGUAGES  (SUCH  AS  HE8REW) 
WHERE  PREFIXES  ARE  ADDED  TO  WORDS. 

3)  TREAT  VERBS  AS  IN  1).  { VER3S  VARY  TOO  MUCH  To  BE  RELIABLE  AT 
FIRST)  . 

4)  IF  SOME  FL  WHOLE  IN  FL I  HAD  PREVIOUSLY  BEEN  FOUND  NOT  TO  BE 
TRANSLATED  (WE  HAD  A  PARTIAL  TRANSLATION  RULE,  OF  TYPE  B,  FOR 
INSTANCE),  THEN  ASSUME  THAT  AGAIN  IT  WILL  NOT  HAVE  TO  BE 
TRANSLATED. 

AFTER  THE  APPLICATION  OF  A  PASS  TO  AN  ELEMENT  OF  FLl,  A 
CHECK  IS  MADE  FOR  CERTAIN  TERMINATING  CONDITIONS)  ALL  FL  WHOLES 
IN  FLl  USED  UP,  ALL  NL  ELEMENTS  IN  NL I  USED  UP,  OR  ONLY  ONE  FL 
WHOLE  LEFT  UNACCOUNTED  FOR.  THE  SYSTEM  ALSO  CHECKS  FOR  POSSIBLE 
AMBIGUITIES.  FOR  EXAMPLE,  SUPPOSE  TWO  DIFFERENT  FL  WHOLES  IN  FLl 
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HAV6  HAD  IDENTICAL  TRANSLATIONS,  TO  BE  FOUND  IN  NL 1 1  THERE  IS  NO 
WAY  TO  HAKE  A  CORRESPONDENCE,  AND  THE  PATTERN  CREATING  ROUTINE 
EXITS  WITH  *  TOO  HARD*  . 

THE  NEXT  STEP  IS  TO  BUILD  TRANSLATION  RULES  FOR  THE 
SUBPATTERNS  CREATED.  AT  THIS  STAGE,  ONLY  TRANSLATION  RULES  OF 
TYPES  A)  AND  B)  ARE  ALLOWED.  THE  RULES  ARE  BUILT  8Y  CONSIDERING 
THE  NL  STRING  INPUT  TO  THE  ROUTINE  AND  MAKING  SURE  THAT  THE 
TRANSLATION  OF  THE  PATTERNS  BUILT  WHEN  MATCHED  TO  THE  INPUT  FL 
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CHAPTER  III. 

LEARNING  RUSSIAN. 

WE  ARE  PRESENTING  HERE  THE  OUTPUT  OF  A  COMPUTER  RUN  DURING 
WHICH  ZBIE  ATTEMPTS  TO  LEARN  RUSSIAN.  THE  OUTPUT  IS  REPRODUCED  AS 
OBTAINED  FROM  THE  PRINTER.  INPUTS  IN  JPL-V  FORM  HAVE  BEEN  DELETED 
EXCEPT  IN  ONE  ILLUSTRATIVE  CASE. 

THE  IMPORTANT  ATTR 1 8 JTES  AND  VALUES  OF  A  PATTERN  PJ  HAVE  THE 
FOLLOWING  MEANING: 

TO(PJ)  =  TRANSLATION  RULE  (A  LIST  STRUCTURE). 

PO(PJ)  =  A  LIST  OF  PATTERNS  WITH  A  P-LIST  IDENTICAL  TO  PJ. 

VO  <  p J  A  =  J4  IF  PJ  IS  A  SU9PATTERN. 

THE  OTHER  ATTRIBUTES  ARE  USED  FOR  BOOKKEEPING  AND  MAY  BE 
DISREGARDED 

COMMENTS  ARE  GIVEN  AT  THE  RIGHT  OF  INPUTS,  0«  AT  THE  END  OF 
THE  PROCESSING  OF  A  SENTENCE. 

LOOKING  AT  SENTENCE  COMMENTS 

(BE  (MAN  >HERE  ) 

ON  ZDES1 


(BE  (MAN  ) THERE  ) 
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ON  TAM 

PROCESS  START 
PUT  INTO  VOCABULARY 
(BE  (MAN  )) 

ON 

P 

PUT  INTO  VOCABULARY 

HERE 

ZDESl 

A3 

P 

PUT  INTO  VOCABULARY 

there 

tam 

A3 

P 

NEW  PATTERN 


<P0 

> 

<9-1  =  25418> 

<9-2  =  2522fi> 

<9-3  = 

02 

9-1 

04  0 

04  0 

O 

-Ck 

CD 

00 

A1 

00  TO 

02  9-3 

00  Y1 

00 

Y1 

02  9-2 

00  Y3 

00  Y ? 

00 

A2 

00 

Y2 

00 

A3 

00 

Y3 

THE  FIRST  TWO  SENTENCES 
TO  START  THE  INITIALIZATION. 

BE  IS  IN  SET  AIj(WOmAN)  In  SET  A?. 

CONTEXT  VOCABULARY  FOR  FL  COMPLEX 

IN-CONTEXT  VOCABULARY  FOR  Fl 
UNIT.  THE  FL  UNIT  (IN  THIS  CASE.- 
HERE  >  IS  INSERTED  In  THE  SET  (IN 
THIS  CASE,  A3) .  Ps Pq. 


-=J 


. .  .vn .... .. .... ...  ,  ■«-  —  t  -  -  ■ 
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COMMENT:  THE  INITIALIZATION  PHASE  IS  OVER.  FOR  THE  NEXT 

sentence,  we  show  the  ipl-v  input, 

COMMENT!  'PUT  INTO  VOCABULARY*  HAS  THREE  OR  FOUR  ARGUMENTS 
EXAMPLES  OF  BOTH  CASES  ARE  ILLUSTRATED  ABOVE: 

i)  THREE  ARGUMENTS.  THE  FIRST  ARGUMENT  IS  AN  FL  COMPLEX,  THE 
SECOND  ARGUMENT  IS  AN  NL  STRING,  THE  THIRD  ARGUMENT  IS  A  PATTERN 
GIVING  THE  CONTEXT.  THE  TRANSLATION  OF  THE  Fl  COMPLEX  IN  THE 
CONTEXT  OF  THE  PATTERN  IS  THE  NL  STRING.  EXAMPLE:  ( BE ( MAN )  ) ,  ON, 
P(=P0)  . 


2)  FOUR  ARGUMENTS.  THE  FIRST  ARGUMENT  IS  AN  FL  UNIT;  THE  SECOND, 
AN  NL  STRING;  THE  THIRD,  A  SET  AND  THE  FOURTH,  A  PATTERN.  THE  FL 
UNiT  IS  FIRST  INSERTED  IN  THE  SET  <  THE  UNIT  MAY  ALREADY  BE  IN  THE 
SET).  THE  TRANSLATION  Or  THE  FL  UNIT  AS  A  MEMBER  OF  THE  SET,  IN 
THE  CONTEXT  OF  THE  PATTERN,  IS  THE  NL  STRING.  WE  REFER  TO  THE 
PAIR  (SET,  PATTERN)  AS  THE  CONTEXT  IN  WHICH  THE  TRANSLATION  OF 
THE  FL  UNIT  IS  THE  NL  STRING.  EXAMPLES!  HERE,  7D5SI,  A3,  P ( =P0 ) : 
THERE,  TAM,  A3,  P(=P0). 


ALL  ADDITIONS  TO  THE  VOCABULARY  ARE  PRINTED  AS  DESCRIBED 


ABOVE. 

IP  INPUT  DATA 


IP  HE 


5  01 

X4  95  0 

95  0 

EO 


IP  (SPEAKING  MAN) 


91 
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IP  here 

E3  0 

IP 

91  0 

IP  SPEAKING 

El 

IP  man 

E2  0 

IP 

*3  95  o 

IP 

95  0 

IP  A1 

Rl 

IP  ZDES1 

R2  0 

IP 

5  JO 

H?  *  2357  CELLS 

00*00*06 

looking  at  SENTENCE  3 

(BE  (SPEAKING  MAN  ) HERE 

) 

A1  ZDES1 

THE  INPUTS  ARE  FIRST  PRINTED 

PROCESS  START 

THEN  78 1 E  STARTS  PROCESSING. 

TRY  PATTERN 

P 

NOT  MATCHED. 

(SPEAKING  MAN)  IS  NOT  IN  A2. 

TRY  LEARN  FROM  PATTERN 

P 

<Z  ZDES1  ) 

Z  STANDS  FOR  THE  UNTRANSLATED 

put  Into  vocabulary 

(BE(SPEAKING  MAN))  FL  COMPLEX. 

(RE  (SPEAKING  MAN  )) 

A1 

THE  RUSSIAN  LETTER  (=1), 

P 

PUT  into  vocabulary 
(SPEAKING  MAN  > 


PATTERN  Pi  IS  BEING  BuIlT. 
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Al 

THE 

RUSSIAN  LETTER  (=1). 

A2 

A  SET  NAME. 

PI 

NEW  PATTERN 

> 

<9-1  = 

25418> 

<9-2  a  2575?> 

<9-3  = 

02  9-1 

04  3 

04  0 

04  0 

00  Al 

00  PO 

00  PO 

00  Y2 

00  Y1 

02  9-2 

00  Y3 

00  A2 

00  YO 

00  Y2 

00  J3 

00  A3 

00  J4 

00  Y3 

00  J3 

00  TO 

02  9-3 

COMMENT  }  PATTERN  Pi  HAS  A  P-UST  IDENTICAL  TO  THE  P-LlST  OF 
PO.  HOWEVER,  THE  TRANSLATION  RULES  ARE  DIFFERENT.  ZB  I E  UsED 
(BE (MAN ) )  *  ON,  AND  (8E  (SPEAKING  MAN))  .*  Al,  BOTH  TRANSLATIONS 
IN  THE  CONTEXT  OF  THE  PATTERN  PO,  FOR  MATCH  BACK.  THE  COMPARISON 
OF  THE  NON-COMMON  PARTS  IN  FL  AND  NL  GAVE  (SPEAKING  MAN)  -*  Al  (IN 
THE  CONTEXT  A2,  Pi).  SINCE  THE  NL  STRINGS  USED  FOR  MATCH-BACK 
HAVE  NOTHING  IN  COMMON,  *  BE '  IS  ASSUMED  NOT  TO  BE  TRANSLATED,  AND 
THE  EXTRACTOR  Y1  OF  THE  SET  Al  (WHICH  CONTAINS  *SE')  IS  NOT  USED 
IN  THE  TRANSLATION  RULE  TO ( PI J  .  IT  IS  WELL  WORTH  COMPARING  THIS 
PATTERN  PI  TO  THE  PATTERN  PI  CREATED  BY  ZB  I E  WHEN  LEARNING  SOME 
GERMAN  (SEE  APPENDIX  B). 
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28 1  £  ALSO  NOTES  THAT  IT  IS  A  'GOOD  GUESS'  TO  ASSUME  THAT  THE 
TRANSLATIONS  OF  A  MEM8ER  OF  Al  IN  THE  CONTEXTS  (A3.P0)  AND  (A3, 
PI)  ARE  THE  SAME. 

LOOKING  AT  SENTENCE  4 
(8E  (SPOKEN  80Y  )HERE  ) 

T 1 2  ZDESl 
PROCESS  START 
TRY  PATTERN 
PI 

NOT  MATCHED. 

TRY  PATTERN 
P 

NOT  MATCHED. 

TRY  LEARN  FROM  PATTERN 
PI 

<2  21)  (SPOKEN  BOY)  IS  NOT  In  SET  A2, 

COESS  'HERE'  IS  NOT  KNOWN  In  thf  CONTEXT 

21  (A3,Pl>,  BUT  IS  GUESSED  TO  BE 

ZDESl  THE  SAME  AS  IN  THE  CONTEXT  (A3»P0>. 

PUT  INTO  VOCABULARY  THE  TRANSLATION  IS  CONSISTENT. 

(SPOKEN  BOY  ) 

T  I  2 
A  2 
PI 
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PUT  INTO  vocabulary 

HERE 

ZDESi 

A3 

PI 

LOOKING  AT  SENTENCE  5 
(BE  (MAN  )HERE  ) 

ON  ZDESI 
PROCESS  START 
TRY  PATTERN 
PI 

PATTERN  MATCHED.  RESULT! 
<Z  ZDESi  ) 
try  pattern 
p 

PATTERN  MATCHED,  result: 
(ON  ZOEbl  J 
TRy  learn  more 
try  learn  Prom  pattern 

PI 

(z  ZDESI  ) 

put  into  vocabulary 

(MAN  ) 

On 

A? 


NOW  'HERE'  is  ALSO  KNOWN  IN 
THE  CONTEXT  (A3, Pi). 


THE  FIRST  SENTENCE  AGAIN, 


(MAN)  IS  NOT  KNOWN  IN 
THE  CONTEXT  (A2,  PI). 


PATTERN  Pi  WAS  MATCHED  ENTIRELY. 


THE  SFNTENCF  WILL  BE  TRANSLATED 


-41- 


P1  THE  pattern  pi  fro*  now  on. 

looking  at  SENTENCE  6 
(BE  (SPEAKING  HAN  ) M AN  ) 

A1  MUGYINA 
PROCESS  START 
TRY  PATTERN 

P1  'MAN*  IS  NOT  IN  THE  SET  A*. 

NOT  MATCHED.  SINCE  PO  HAS  THE  SAME  P-LIST  AS 

TRY  PATTERN  Pi,  THE  HATCH  ON  PO  IS  NOT 

p  attempted. 

not  matched. 

try  learn  from  pattern 

PI 

<Al  z  ) 

put  into  vocabulary 

MAN 

mugyina 

A3 

PI 


LOOKING  AT  SENTENCE  7 
<8E  (HAN  )MAn  ) 

ON  MUGYINA  A  N?w  SENTENCE „ 

PROCESS  START 


TRY  PATTERN 
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PATTERN  MATCHED.  RESULT! 

{ ON  MUGYINA  )  translated  COMPLETELY. 

looking  at  sentence  8 

(BE  (SPOKEN  80Y  )80Y  > 

T I  2  MALLYIK 
PROCESS  START 
TRY  PATTERN 
PI 

NOT  MATCHED. 

TRY  PATTERN 
P 

NOT  MATCHED. 

TRY  LEARN  FROM  PATTERN 
PI 

(  T  I  2  Z  > 

PUT  INTO  VOCABULARY 

go Y  building  up  the  VOCABULARY. 

maliyik 
A3 
PI 

LOOKING  at  SENTENCE  9 
(BE  <S°OKEN  GIRL  >GIRL  > 

T I  2  DEVOYKA 
PROCESS  START 


try  pattern 


(SPOKCN  GIRL)  IS  NOT  IN  SFT  A?# 
'GIRL*  IS  NOT  IN  SET  A3. 
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P1 

NOT  MATCHED. 

TRY  PATTERN 
P 

NOT  MATCHED. 

TOO  HARD 

TWO  MISTAKES  AT  ONE  LEVEL  WERE  08TA I  NED  DURING  PATTERN 
MATCHING,  SO  THAT  NO  PATTERN  Is  CLOSE'  TO  THE  Fl  SENTENCE.  THE 
TWO  FL  UNITS  (SPOKEN  GIRL)  AND  ’GIRL*  CANNOT  8E  TRANSLATED  IN  ANY 
CONTEXT  (AT  THIS  STAGE),  AND  NO  NEW  PATTERN  CAN  BE  BUILT  TO 
TRANSLATE  THE  SENTENCE.  NOTE  THAT  IF  ZBIE  HAD  USED  SOME  OF  THE 
SEMANTICS  BUILT  INTO  FL  TO  GUESS  THAT  (SPOKEN  GIRD  MAY  WELL  HAVE 
A  TRANSLATION  IDENTICAL  TO  (S=OXEN  BOY),  IN  THE  SAME  CONTEXTS, 
THEN  THE  SENTENCE  COULD  HAVE  BEEN  PROCESSED  SUCCESSFULLY  AT  THIS 
STAGE.  THE  GUESSED  TRANS- AT  I  ON  WOULD  HAVE  BEEN  »  T 1 2  7',  WHICH  IS 
CONSISTENT  WITH  THE  INPUT. 

WE  SHALL  HEREAFTER  LEAVE  OJT  THE  MONOTONOUS  ’TRY  PATTERN  .. 
PJ  .  . .  NOT  MATCHED  . . . ' . 

LOOKING  AT  SENTENCE  10 

(BE  BOY  )  THIS  SENTENCE  MATCHES  NO 

E2T0  MALI Y I K  PREVIOUS  PATTERNS. 

PUT  INTO  VOCABULARY  CREATING  PATTERN  P2. 

BE 


E2T0 
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A4  A  NEW  SET. 

P2 

PUT  INTO  VOCABULARY 
BOY 

HAL1YIK 

A3  THE  SAME  TRANSLATION  AS 

P2  IN  THE  CONTEXT  <A3,P1>. 

NEW  PATTERN 


<P2> 

<9-1  =  26178> 

<9-2  =  26l?0> 

<9-3  = 

02  9-1 

04  0 

04  0 

04  0 

00  A 4 

00  TO 

on  Y 1 

00  Y1 

00  Y1 

02  9-2 

00  Y? 

00  Y2 

00  A3 

00  D12 

00  Y2 

02  9-3 

00  D13 

04  26180 

COMMENTS:  THE  SENTENCE  IN  FL  HAS  A  LENGTH  OF  TWO,  PREVIOUS 
PATTERNS  EXPECT  AN  FL  SENTENCE  OF  LENGTH  THREE.  TO  BUILD  THE  NEW 
PATTERN,  ZB  I E  TRIED  TO  FIND  TRANSLATIONS,  FOR  THE  FL  UNITS  IN  THE 
FL  SENTENCE,  WHICH  WERE  IDENTICAL  OR  CLOSE  TO  NL  STRINGS  IN  THE 
INPUT  NL.  'BE'  HAD  NO  TRANSLATION)  HOWEVER,  '90Y»  HAD  A 
TRANSLATION  ' MALI Y I K  ' ,  IN  THE  CONTEXT  (A3,  Pl>  (SEE  SENTFNCE  A), 
WHICH  IS  FOUND  IN  THE  INPJT.  THE  FL  UNIT  ’BE*  WHICH  HAD  NOT  BEEN 
ACCOUNTED  FOR  IS  MATCHED  TO  THE  REMAINING  PARTS  OF  THE  NL  INPUT, 
NAMELY  *  E2T0 '  .  Z  B I E  ALSO  MAKES  A  NOTE  THAT  IT  1?  A  ‘GOOD  GUESS' 
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TO  ASSUME  THAT  THE  TRANSLATIONS  OF  AN  Fl  UNIT  IN  THE  CONTEXTS 
(A3*P2>  AND  (A3, PI)  ARE  IDENTICAL. 

LOOKING  AT  SENTENCE  11 
(3E  FOOT  ) 

E2T0  NOG1A  BUILDING  UP  THE  VOCABjLARy. 

PROCESS  START 

TRY  LEARN  FROM  PATTERN 

P2 

(E2T0  2  ) 

PUT  INTO  VOCABULARY 

FOOT 

NOG1A 

A3 

P2 

LOOKING  AT  SENTENCF  1? 

(be  foot  i of  boy  i > 

E2T0  N0G1A  MAL1YIKA 
PROCESS  START 

translate 

P2 

RESULT! 

(E2T0  2  ) 

TRY 


NOT  A  LINEAR  FL  SENTENCE. 


Z  STANDS  FOR  THE  TRANSLATION  OF 
THE  FL  COMPLEX  FOOTIOF  BOY),  AND, 

BY  THE  CONSISTENCY  TEST,  7  IS  TO  BE 


P2 


REPLACED  BY  ' NOG1 A  M A tlY  I  K  A  '  . 
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PUT  INTO  VOCABULARY 
BOY 

maliyika 

A6 

P38 

PUT  INTO  VOCABULARY 

FOOT 

NOG1A 


building  subpatterns  P39  and  p3b. 


a  different  translation, 

USING  A  DIFFERENT  SET. 


A3 

P39 

put  Into  set 

P38 

a; 

NEW  PATTERN 


THE  SAME  TRANSLATION  AS  In 
THE  CONTEXT  (A3,P2>. 

THE  SUBPATTERN  P38  IS  INSERTED 
AT  THE  TOP  OF  THE  SET  A7. 


<P38> 

<9- 

1  =  26  4  74  > 

<9-?  =  26766> 

02 

9-1 

04 

0 

04  0 

00 

A5 

00 

TO 

00  Y100 

00 

Y 1 0 1. 

02 

9-2 

OC 

A6 

00 

D12 

00 

Y100 

02 

9-3 

00 

D13 

04 

26646 

00 

D9 

00 

A7 

00 

VO 

00 

J4 

<9-3  = 

04  0 

no  yi 0 0 


¥ 
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<P39> 

<9-1 

e  26454> 

<9-2  *  26?88> 

<9-3  ~ 

02  9-i 

04 

0 

04  0 

04  0 

00  A 7 

00 

TO 

00  Y90 

00  Y98 

00  Y99 

02 

9-2 

00  Y99 

00  Y99 

00  A3 

00 

D12 

00  Y98 

02 

9-3 

00 

D13 

04 

26678 

00 

VO 

00 

J4 

2<-69?> 


PUT  INTO  SET 
P39 

A3 


COMMENTS:  LET  US  CAREFULLY  50  OVER  OUR  FIRST  ENCOUNTER  WITH 
A  NON-LINEAR  FL  SENTENCE.  AT  THE  TOP  LEVEL,  THE  FL  SENTENCE 
MATCHES  partly  THE  PATTERN  P2I  ’BE'  IS  AN  ELEMENT  OF  A4,  BUT  THE 
SET  A3  HAS  NO  SUBPATTERN  MEMBERS.  CONSEQUENTLY,  THE  FL  COMPLEX 
FOOT  I  OF  BOY)  CANNOT  BE  MATCHED. 


THE  TRANSLATIONS  IN  =ARALL5L  OF  PATTERN  LISTS  HAVING  MATCHED 
THE  F|_  SENTENCE  TO  THE  DEEPEST  MATCH-DEPTH  ARE  TRIED.  THIS  ACTION 
FOLLOWS  'TRANSLATE'.  HERE,  ONLY  ONE  PATTERN,  P2,  IS  FOUND.  THEN, 
THE  PATTERN  LISTS  WITH  A  CONSISTENT  TRANSLATION  ARE  TRIED.  THIS 
ACTION  FOLLOWS  'TRY'.  HERE  WE  ONLY  'TRY'  THE  PATTERN  P?.  BY  THE 


CONSISTENCY  TEST,  THE  FL  COMPLEX  FOOTtOF  BOY)  CORRESPONDS  TO  THE 
NL  STRING  ' NOGl A  MAL1YIKA',  AND  THE  PATTERN  CREATING  ROUTINE 


manages  to  build  surpatterns  TO  MATCH  THE  FI  COMPLEX.  note  That 
PREVIOUS  KNOWLEDGE  HAS  BEEN  USED  TO  AVOID  BUILDING  A  WHOLE  NEW 
TUP  PATTERN. 

WHEN  BUILDING  THE  SUBPATTERNS,  THE  TRANSLATION  OF  'FOOT'  IN 
THE  CONTEXT  <A3,P2>  IS  USED.  THE  PREVIOUSLY  ENCOUNTERED 
TRANSLATION  OF  'BOY»,  ’  MAL'lY IK • ,  IS  NOT  FOUND  IN  THE  NL  STRING 
HOWEVER.  *  MALi Y I K  *  IS  VERY  CLOSE  TO  »  MALlY  I K  A  * ,  SO  THAT  THE 
TRANSLATION  OF  'BOY*.  IN  A  NEW  CONTEXT*  IS  ASSUMED  TO  BE 
*  MALI Y I KA '  •  SINCE  ALL  THE  WORDS  IN  THE  NL  STRING  *NOGlA  MALlYlKA' 
HAVE  BEEN  ACCOUNTED  FOR,  *OF»  Is  ASSUMED  NOT  TO  BE  TRANSLATED. 

THE  P-LIST  OF  THE  SU3PATTERN  P39  CONTAINS  TWO  SETS.  THE  SET 
A3  CONTAINS  FOOT  (AND  MANY  OTHER  FL  UNITS);  THE  SET  A7  CONTAINS 
THE  SUBPATTERN  P3R .  P38  MATCHES  THE  FL  COMPLEX  STRUCTURE  [OF 
BOY  I  *  SINCE  'OF*  IS  A  MEMBER  OF  THE  SET  A5  AND  *30Y',  OF  THE  SET 
A6. 

LET  US  VISUALIZE  THE  SAME  SENTENCE  BEING  MATCHED  AGAIN  TO 
THE  PATTERN  LIST  <P2  =39  P38).  A  MATCH  OF  THE  FL  COMPLEX 

STRUCTURE  FOOTIOF  BOY]  IS  ATTEMPTED  AGAINST  THE  SUBPATTERN  P]9, 
MEMBER  OF  A3.  A  MATCH  OF  THE  FL  COMPLEX  STRUCTURE  [OF  BOy)  IS 
ATTEMPTED  AGAINST  THE  SU8=ATTERN  P3H,  MEMRER  OF  A5.  ALL  MATCHES 
SUCCEED.  THE  TRANSLATION  RULE  OF  P?  CAULS  FOR  THE  TRANSLATION  OF 
THE  STRUCTURE  FOOTIOF  BOY)  MATCHED  AGAINST  P39.  THE  TRANSLATION 
RULE  OF  P39  CALLS  FOR  THE  TRANSLATION  OF  THE  ELEMENT  MATCHED  TO 
A3,  'FOOT4,  IN  THE  CONTFXT  <A3,P39),  WHICH  Is  'NOGiA'  ( Y9 A )  , 
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F  OLLOwED  BY  THE  TRANSL AT  1 ON  OF  THE  FL  COMPLEX  (OF  BOY)  MATCHED  TO 
P38*  ( Y99 )  .  THE  TRANSLATION  RULE  OF  P38  CALLS  FOR  THE  TRANSLATION 
OF  THE  ELEMENT  MATCHED  TO  A6*  'BOY*,  IN  THE  CONTEXT  (A6*P38>, 
NAMELY  ' MALI Y I KA  *  »  <  Y1 0 0  > .  THE  TRANSLATION  ROUTINE  IS  SEEN  TO 

CALL  on  itself  recursively. 

NOTE  THAT  WHILE  THE  PATTERN  P39  IS  A  MEMBER  OF  THE  SET  A3, 
THE  P-LIST  OF  P39  CONTAINS  THE  SAME  SET  A3*  SO  THAT  AN  INFINITELY 
RECURSIVE  PATTERN-TREE  IS  ALREAOY  POSSIBLE.  WHEN  USING  MORE  THAN 
ONE  TOKEN  OF  THE  SAME  PATTERN,  CARE  MUST  BE  TAKEN  TO  USE*  ALSO, 
TOKENS  OF  THE  EXTRACTORS. 

PATTERN  P38 ,  WHICH  MATCHES  (OF  BOY),  IS  A  MEMBER  OF  THE  SET 
A7 .  A  7  OCCURS  ABOVE  THE  SET  A3  (WHICH  CONTAINS  'BOY')  IN  THE 
P-LIST  OF  THE  PATTERN  P 39.  THIS  PECULIARITY  IS  DUE  TO  THE  IPL-V 
IMPLEMENTATION  OF  THE  SQUARE-BRACKETED  DESCRIPTION  LIST  IN  Ti_,  AS 
DESCRIBED  IN  CHAPTER  II,  3APT  A. 

LOOKING  AT  SENTENCE  13 
(BE  HAND  (OF  BOY  1 ) 

E2T0  RUK A  MALJYIKA 
PROCESS  START 
TRANSLATE 

P2  THE  PATTERN  LIST. 

P39 

P3B 


RESULT* 
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C  F  2  T  0  7  HALiYiKA  )  'HAND*  IS  NOT  IN  SET  A3. 

TRY 
P? 

P39 
P36 

PUT  INTO  VOCABULARY 
HANU 
RUK  A 
A3 
P39 

LOCKING  AT  SENTENCE  14 
(BE  HAND  ) 

E2TO  RUK A 
PROCESS  START 
TRY  PATTERN 
P2 

PATTERN  MATCHED.  RESULT » 

(E2TQ  7  ) 

TRY  LEARN  FROM  PATTERN 
P2 

<E?TO  7  ) 

GUESS 
Z 

RUK  A 


'HAND'  IS  NOT  KNOWN  IN  THE 
CONTEXT  (A3.P2). 

but  'wand'  can  be  guessed,  using 
THE  SIMILAR  CONTEXTS  <A3,P2) 

AND  (A 3,239). 


LOOKING  AT  SENTENCE  15 
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< 9E  book  ) 

E2T0  KNIG1A 

PROCESS  START 

try  learn  from  pattern 

p? 

(E2T0  Z  ) 

put  into  vocabulary 

BOOK 

KNI31A 

A3 

P2 

LOOKING  AT  SENTENCE  16 
(Q  BE  SOCK  WHERE  ) 

G1D6  KNIG1A 
PROCESS  START 

put  into  vocabulary 

WHERE 

SIDE 

A10 

P3 

put  into  vocabulary 

book 

KNIG1A 

A3 

P3 


MORE  VOCABULARY. 

q  means  ouestion;  it  is  A 
marker,  and  is  not  to  be 
translated. 

BUILDING  PATTERN  P3 . 


m  # i  * 


t  ■-*  ~  -  ?■  * 

<  *•»%  5 

02  9-1 

04  0 

04  0 

04  n 

00  A8 

00  TO 

00  Y4 

no  Y4 

00  Y1 

02  9-2 

00  Y3 

no  Y3 

00  A 9 

00  012 

00  Y2 

02  9-3 

00  A3 

00  D13 

00  Y3 

04  26952 

00  A10 

Of  Y4 

COMMENT!  NOTICE  THE  TRANSLATION  RULE. 


LOOKING  AT  SENTENCE  17 
(BE  (IN  (BOOK  ) HAND  >> 
ONA  V  RUKE 
PROCESS  START 
TRANSLATE 
P2 

RESULT! 

(E2T0  Z  > 

TOO  HARD 


NOT  CONSISTENT. 


80TH  ( 800K }  AND  'IN'  ARE  UNKNOWN,  AND  A  NEW  TOP  PATTERN 
COULD  NOT  8E  CREATED.  ZBIE  WILL  NOW  LEARN  (BOOK),  THEN  RETURN  TO 
THE  SAME  SENTENCE.  'HAND'  COULD  BE  GUESSED  FROM  '  RUK A '  TO  'RUKE' 


LOSING  AT  SgNTENCf;  18 
(BE  (BOOK  )«6RE  ) 

ONA  ZDES1 
PROCESS  START 

try  learn  from  pattern 
pi 

<2  20ES1  ) 

PUT  INTO  VOCABULARY 
(BOOK  ) 

ONA 

A2 

PI 


NOW  (BOOK)  IS  KNOWN  AS  *ONA* 
IN  THE  CONTEXT  (A2,P1>. 


LOOKING  AT  SENTENCE  19 
(BE  (IN  (BOOK  )HAND  )) 
ONA  V  RUKE 
PROCESS  START 

translate 

P2 

RESULTI 
(E2T0  2  ) 

put  Into  vocabulary 
hand 


IDENTICAL  TO  SENTENCE  17, 


NOT  CONSISTENT. 
BUILDING  PATTERN  P4. 


ruke 


P3? 

PU?  InT$  VOCASyiARY 

IN 

V 

A12 

P37 

pur  into  vocabulary 

(BOOK  ) 

ONA 

A2 

P37 

PUT  INTO  SET 
P37 

A14 

NEW  PATTERN 


:P37> 

<9-1  *  26506> 

<9-2  «  27334> 

<9-3  = 

02  9-1 

04  0 

04  0 

04  0 

00  A12 

00  TO 

00  Y96 

CO  Y96 

00  Y97 

02  9-2 

00  Y97 

00  Y97 

00  A2 

00  012 

00  Y95 

00  Y95 

00  Y96 

02  9-3 

00  A13 

00  013 

00  Y95 

04  27144 

00  09 

00  A14 

00  VO 

- 
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<P4> 

<9«1  *  2?164> 

<9-2  *  273$8> 

<9-3  » 

0?  ?-i 

04  0 

04  9 

04  0 

00  All 

00  TO 

00  Y? 

00  Y2 

00  Y1 

02  9-2 

00  A14 

00  D12 

00  Y2 

02  9-3 

00  D13 

04  27162 

COMMENT *  PATTERNS  *2  AND  P4  ROTH  HAVE  TwO  SETS  ON  THglR 
P'LlSTS,  BUT  THESE  SETS  AND  THE  TRANSLATION  RULES  OF  THE  PATTERNS 
ARE  QUITE  DIFFERENT.  THE  TRANSLATION  RULE  OF  P37  IS  WORTH  NOTING. 

looking  AT  sentence  20 

(BE  (IN  (BOOK  >HAND  (OF  BDY  ]>> 

ONA  V  RUKE  MAL1YIKA 
PROCESS  START 

translate 

P4 
P37 

RESULT  t 
(ONA  v  1  ) 

TRY 
P4 


P37 


A  CONSISTENT  TRANSLATION, 
HANDIOF  BOY J  CORRESPONDS  TO 
RUKE  MAL1YIKA. 


VMt 


mi  imo  luuBfsm  n$  km  n%> 

HAKO 

RUKfi 

A1$  NOT  A  NEW  SETiSEE  SENTENCE  19*. 

P36 

put  into  vocabulary 

BOY 

mauyika 

A6  NOT  A  NEW  SETCSEE  SENTENCE  12*. 

P35 

PUT  INTO  SET 

P35 

A16 

NEW  PATTERN 


<P35> 

<9-1  *  2753 ?> 

<9-2  *  2777&> 

<9-3  = 

02  9-1 

04  0 

04  0 

04  0 

00  A15 

00  TO 

00  Y93 

00  Y93 

00  Y94 

02  9-2 

00  A6 

00  012 

00  Y93 

02  9-3 

00  013 
04  27674 
00  09 
00  A16 
00  V0 
00  J4 
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<P36> 

<9*1 

*  Hi 5S> 

<9-2  •  V1U> 

<9*3  * 

82  9~i 

04 

0 

04  0 

04  0 

98  A16 

00 

TO 

60  Y91 

08  Y9i 

80  Y92 

02 

9-2 

00  Y92 

00  Y9? 

00  A13 

00 

D12 

90  Y91 

02 

9-3 

00 

D13 

04 

27706 

00 

VO 

00 

J4 

LOOKING  AT  SENTENCE  21 
I  BE  PENCIL  > 

E2T0  KARANDAW 
PROCESS  START 
TRY  LEARN  FROM  PATTERN 

P4  WHEN  THE  TRANSLATION  IS  JUST  Z, 

<Z  >  WE  WAIT  THE  FIRST  TIME  AROUND. 

WAIT 

TRY  LEARN  FROM  PATTERN 
P2 

(E2T0  Z  )  CONSISTENT  TRANSLATION. 

PUT  INTO  VOCABULARY 

PENCIL 

KARANDAW 


A3 


IF  WE  HAD  PROCESSED  *4  FIRST,  Ug  WOULD  HAVE  OBTAINED* 
PUT  INTO  VOCABULARY 
PENCIL 

E2T0  KARANDAW 
A14 
P4 

LOOKING  AT  SENTENCE  22 
(Q  BE  PENCIL  WHERE  ) 

SIDE  KARANDAW 
PROCESS  START 
TRY  PATTERN 
P3 

(SIDE  Z  ) 

TRY  LEARN  FROM  PATTERN 
P3 

(SIDE  Z  > 

GUESS 
Z 

KARANDAW 

PUT  INTO  VOCABULARY 
PENCIL 
KARANDAW 
A3 
P3 


'PENCIL*  IS  NOT  KNOWN  IN  THE 
CONTEXT  <A3.P3>. 

HOWEVER,  THE  TRANSLATION  OF 
'PENCIL*  CAN  BE  GUESSED  FROM  THE 
CONTEXT  ( A3, Pp)  TO  THIS  CONTEXT » 
<A3,P3>. 


If  ‘S30D  GUfSSEf*  *iA0  seen  used,  this  sentence  WOULD  have 
8EEN  TRANSLATED. 

LOOKING  AT  SENTENCE  23 
(BE  (PENCIL  > THERE  ) 

ON  TAM 

PROCESS  START 

try  learn  from  pattern 

PI 

(Z  Z1  >  the  guess  makes  the  translation 

GUESS  CONSISTENT  WITH  THE  INPUT. 

Z1 

TAM 

PUT  INTO  VOCABULARY 
(PENCIL  > 

ON 
A  2 

PI  MORE  VOCABULARY. 

PUT  INTO  VOCABULARY 

THERE 

TAM 

A3 

PI 

LOOKING  AT  SENTENCE  24 


(BE  (IN  (PENCIL  IDRAWER  )) 


0*  v 

PROCESS  START 

translate 

P4 

P37 

RESULTI  even  without  the  guess#  the 

(z  v  21  )  translation  is  consistent  with 

GUESS  THE  NL  INPUT, 

z 

ON 

TRY 

P4 

P37 

PUT  INTO  VOCABULARY 
(PENCIL  > 

ON 

A2 

P37 

PUT  INTO  VOCABULARY 

DRAWER 

A1WZIKE 

A13 

P37 


LOOKING  AT  SENTENCE  25 
(BE  BOY  (MOD  THIS  J  HERE  ) 


itm 

PROCESS  STAR? 

translate 

PI 

RESULT! 

(Z  ZDESi  ) 

TRY 

PI 

PUT  INTO  VOCABULARY  BUILDING  SUBPATTERNS  P34  AND  P33. 

THIS 

E2T0T 

A16 

P33 

put  Into  vocabulary 

BOY 

MAL1YIK 

A3 


P34 

put  into  set 

P33 

A19 

NEW  PATTERN 

<P33>  <9-1  =  27360>  <9-2  =  278l2> 

02  9-1  04  0  o*  0 

00  A17  00  TO  00  Yfl9 

00  Y90  02  9-2 


<9-3  =  2  •  '?  ■> 
04  0 
00  YBo 


I 


62 


00 

A18 

00 

D12 

00 

Y89 

02 

9-3 

00 

013 

04 

26168 

00 

09 

OG 

A19 

00 

VO 

00 

J4 

<P34> 

<9-1  =  26422> 

<9-2  *  2784o> 

<9-3  a 

02  9-1 

04  0 

04  0 

04  0 

00  A19 

00  TO 

00  Y88 

00  Y89 

00  Y88 

02  9-2 

00  Y87 

00  Y8? 

00  A3 

00  D12 

00  Y87 

02  9-3 

00  013 
04  27722 
00  VO 
00  J4 


PUT  INTO  SET 

P34 

A2 


LOOKING  AT  SENTENCE  26 
(BE  GIHL  > 

E2T0  DEVOYKA 
PROCESS  START 


27Soh> 


-ft  - 


TRY  LEARN  FROM  PATTERN 
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WAIT 

TRY  LEARN  FROM  PATTERN 


(E2T0  1  ) 

PUT  INTO  VOCABULARY 

GIRL 

DEVQYKA 


MORE  VOCABULARY. 


LOOKING  AT  SENTENCE  27 
(BE  (SPOKEN  GIRL  >GIRL  > 
TI2  DEVOYKA 
PROCESS  START 


THIS  IS  SENTENCE  9.  WHICH  HAD 

been  found  *too  hard'  previously. 


TRY  LEARN  FROM  PATTERN 


(Z  Z1  ) 
GUESS 


NOW,  WE  USE  THE  TRANSLATION  OF 
•GIRL’  IN  THE  CONTEXT  <A3,P2> 

AS  A  ‘GUESS*  (SEE  SENTENCE  26). 


DEVOYKA 

PUT  INTO  VOCABULARY 
(SPOKEN  GIRL  ) 


t 


PUT  INTO  VOCABULARY 

GIRL 

DEVOYKA 

A3 

Pi 


LOOKING  AT  SENTENCE  28 

(BE  GIRL  I  HOD  THIS  j  HERE  ) 

E2TA  DEVOYKA  ZDESl 

PROCESS  START 

MATCHED  PATTERN-LIST 

PI 

P34 

P33 

RESULT  * 

(E2TOT  Z  ZDESi  ) 

translate 

pi 

P34 

RESULT  * 

<Z  Z1  ZDESl  ) 

GUESS 

Zi 


PATTERN-LIST  MATCHING  THE  FL 
SENTENCE  TO  A  MATCH-DEPTH  OF  2. 


NOT  CONSISTENT, 

PATTERN  LIST  MATCHING  THE  FL 
SENTENCE  TO  A  MATCH-DEPTH  OF  1. 


WITH  THE  GUESS#  THE  TRANSLATION 
IS  CONSISTENT  WITH  THE  NL  INPUT. 


DEVOYKA 


—  ft#- 


i 


TRY 

PI 

P34 

PUT  INTO  VOCABULARY 

THIS 

E2T* 

A21 

P32 

NEW  PATTERN 
NOT  INSERTED 
TRANSLATE 
Pi 

RESULT! 

(Z  ZDES1  > 

TRY 

PI 

PUT  INTO  VOCABULARY 

GIRL 

DEVOYKA 

A3 

P31 

PUT  INTO  VOCABULARY 

THIS 

E2TA 

A21 

P30 
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SEE  COMMENTS  BELOW. 

PATTERN  LIST  MATCHING  THE  FL 
SENTENCE  TO  A  MATCH-DEPTH  OF  0. 

CONSISTENT  WITH  INPUT.  Z  TAKES 
THE  PLACE  OF  GIRLIMOD  THIS). 

BUILDING  SUBPATTERNS  »30  AND  P3i 


V? 


h 


M 

i 


~66" 


PUT  INTO  SET 

P30 

A23 

NEW  PATTERN 


<P30> 

<9-1  *  28520> 

<9-2  «  f8752> 

<9-3  *  2H*50> 

02  9-i 

04  0 

04  0 

04  0 

00  A22 

00  TO 

00  Y83 

00  Y83 

00  Y84 

02  9-2 

00  A21 

00  012 

00  Y83 

02  9-3 

00  013 

04  28636 

00  09 

00  A23 

00  VO 

00  J4 

<P31> 

<9-1  *  2839?> 

<9-2  •  28762> 

<9-3  =  2flM?> 

H 

1 

O 

CM 

o 

04  0 

04  0 

04  0 

00  A23 

00  TO 

00  Y*2 

00  Y82 

00  Y82 

02  9-2 

00  Y81 

00  Y81 

00  A3 

00  012 

00  Y81 

02  9-3 

00  D13 
04  28668 
00  VO 


'-  *  •  ffl- 


-67- 

PUT  INTO  SET 
P31 

A2  \ 

•v 

HERE  IS  OUR  FIRST  ENCOUNTER  WITH  ZBIE*S  LOOK-AHEAD 

CAPABILITIES.  THE  FL  SENTENCE  IF  FIRST  MATCHED  TO  A  MATCH-DEpTH  I 

i 

OF  2  BY  THE  PATTERN-LIST  (PI  ?34  P33)  BUT  THE  TRANSLATION  IS  NOT  ] 

CONSISTENT  WITH  THE  NL  INPUT.  SINCE  THE  FIRST  NL  WORDS  OF  THE 
TRANSLATION  AND  INPUT  ARE  DIFFERENT.  NEXT #  T«E  FL  SENTENCE  IS 
MATCHED  TO  A  MATCH-DEPTH  OF  i  3Y  THE  PATTERN-LIST  (Pi  P34).  THE 
FL  STRUCTURE  I  MOD  THIS!  HAS  NO  CORRESPONDING  SUBPATTERN  TO  WHICH 
IT  IS  THEN  MATCHED  AND  CONTRIBUTES  THE  UNKNOWN  Zt=Z0>  TO  THE 
TRANSLATION  OF  THE  FL  SENTENCE.  ’GIRL*  IS  NOT  KNOWN  IN  THE 
CONTEXT  (A3.P34),  AND  CONTRIBUTES  THE  UNKNOWN  Zl.  SINCE  THE 
TRANSLATION  OF  ’GIRL'  CAN  BE  CORRECTLY  GUESSED,  THE  TRANSLATION 
OF  THE  FL  SENTENCE  IS  CONSISTENT  WITH  THE  INPUT.  THE  UNKNOWN  Z 
TAKES  THE  PLACE  OF  THE  FL  STRUCTURE  [MOD  THlSj  AND,  BY  THE 
CONSISTENCY  TEST,  IS  TO  BE  REPLACED  BY  THE  FL  SENTENCE  IS  FIRST 
MATCHED  TO  A  HATCH-DEPTH  OF  2  BY  THE  PATTERN-LlST  (pi  P34  P33). 

BUT  THE  TRANSLATION  IS  NOT  CONSISTENT  WITH  THE  NL  INPUT  SINCE  THE 
FIRST  NL  WORDS  OF  THE  TRANSLATION  AND  INPUT  APE  ISOMOPPHJC  TO 
P32.  < WE  WOULD  ONLY  REQUIRE  THAT  P32  BE  A  HOMOMORPHIC  IMAGE  OF  A 
SUBPATTERN  IN  A19).  P32  IS  ’NOT  INSERTED’  IN  Al9  AND  THE  NEXT 

PATTERN  LIST  IS  TRIED.  SENTENCE  3(1  WILL  PROVIDE  ANOTHER  EXAMPLE 
OF  THE  SAME  TECHNIQUES. 


A 
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LOOKING  AT  SENTENCE  29 
(BE  TREE  ) 

E2T0  DSREVO 

PROCESS  START 

TRY  LEARN  FROM  PATTERN 

P4 

cz  ) 

WAIT 

TRY  LEARN  FROM  PATTERN 
P2 

(E2T0  Z  i 

PUT  INTO  VOCABULARY 

TREE 

DEREVO 

A3  MORE  VOCABULARY  BEFORE 

P2  THE  NEXT  SENTENCE. 

LOOKING  AT  SENTENCE  30 
(BE  TREE  (MOD  THIS  J  HERE  ) 

E2T0  DEREVO  ZDESl 
PROCESS  START 
MATCHED  PATTERN-LIST 
PUT  INTO  VOCABULARY 
TREE 
DEREVO 


A3 


MORE  VOCABULARY  BEFORE 


P  2 

looking  AT  SENTENCE  30 

( 9E  TREE  (MOD  THIS  1  HERE  > 

E2T0  DEREVO  ZDESl 

PROCESS  START 

MATCHED  PATTERN-LIST 

PI 

P32 

P30 

RESULTI 

(E2TA  7  ZDESl  ) 

MATCHED  PATTERN-LIST 

PI 

P34 

P33 

RESULTI 

(E2T0T  Z1  ZDESl  ) 

TRANSLATE 

PI 

P31 

RESULTI 
(Z  Zi  ZDESl  ) 

GUESS 

Zl 


THE  NEXT  SENTENCE. 


•TREE'  IS  NOT  KNOWN  IN  THE 
CONTEXT  (A3, P31 >  *  BUT  CAN  RE 
GUESSED  FROM  THE  CONTEXT 
(A3.P2) . 

NOT  CONSISTENT. 

•TREE'  IS  NOT  KNOWN  IN  THE 
CONTEXT  ( A3»  P.34  > » BUT  CAN  BE 
GUESSED  FROM  THE  CONTEXT 
<A3,P2> . 

NOT  CONSISTENT. 

PATTERN-LIST  WITH 
MATCH-DEPTH  OF  1. 

CONSISTENT  AFTER  GUESS. 


DEREVO 
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TRANSLATE 

PI 

P34 

RESULT! 

<Z2  Z3  ZOESl  ) 

GUESS 

Z3 

DER6V0 

TRY 

PI 

P3i 

PUT  INTO  VOCABULARY 

THIS 

E2T0 

A25 

P29 

NEW  PATTERN 


ALSO  A  PATTERN-LIST  WITH 
MATCH-DEPTH  OF  1*  TRANSLATED 
•IN  PARALLEL*  WITH  THE  ABOVE 
PATTERN-LIST  (Pi  P3i> . 
CONSISTENT  AFTER  GUESS. 


NO  PREFERENCE  BETWEEN  THE 
PATTERN-LISTS,  SO  *  TRY  *  THE 
FIRST  ONE  CONSIDERED  FIRST. 
BUILDING  SURPATTERN  P?9. 


<P29> 

<9-1  *  29028> 

<9-2  *  29154> 

<9-3  a 

02  9-1 

04  0 

04  0 

04  n 

00  A24 

00  TO 

00  Y79 

00  Y79 

00  Y0Q 

02  9-2 

00  A25 

00  D12 

00  Y79 

02  9-3 

00  D13 

04  29142 

00  VO 

2  9 1 5 
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i 


00  J4 

not  inserted 

try 

pi 

P34 

PUT  INTO  VOCABULARY 

THIS 

E2T0 

A25 

P28 

NEW  PATTERN 


PP9  IS  ISOMORPHIC  TO  P30. 
the  next  pattern-list. 


building  subpattern  pga. 


RESULT  * 

<Z  ZDES1  ) 


<P28> 

<9-1  =  29148>  <9-2  *  29258> 

<9-3 

02  9-1 

04  0 

04  0 

04 

00  A26 

00  TO 

00  Y77 

00 

00  Y78 

02  9-2 

00  A25 

00  D12 

00  Y77 

02  9-3 

00  013 

04  29122 

00  VO 

00  J4 

not  inserted 

P?8  IS  ISOMORPHIC  TO  P33. 

translate 

pattern-list  WITH 

pi 

MATCH-DEPTH  OP  0. 

1 
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TRY 

Pi 

PUT  INTO  VOCABULARY  BUILDING  SUBPATTERNS  P27  AND  P26, 

TREE 

DEREVO 

A3 

P27 

PUT  INTO  VOCABULARY 
THIS 

E2T0  *62TQ»  WAS  ALSO  THE  TRANSLATION 

A25  OP  *86'  IN  THE  CONTEXT  <A4,P2>. 

P26 

PUT  INTO  SET 

P26 

A28 

NEW  PATTERN 


<P26> 

<9-1 

s  29082> 

<9-2  «  29476> 

<9-3  * 

02  9-1 

04 

0 

04  0 

04  0 

00  A27 

00 

TO 

00  Y75 

00  Y75 

00  Y76 

02 

9-2 

00  A25 

00 

D12 

00  Y75 

02 

I 

CM 

00 

D13 

04 

29398 

00 

09 

00 

A28 

-73 


00  VO 

00  J4 

<P27> 

<9-1  =  29150> 

<9-2  *  29526> 

<9-3  = 

02  9-1 

04  0 

04  0 

c 

V 

o 

00  A28 

00  TO 

00  Y74 

00  Y74 

00  Y74 

02  9-2 

00  Y73 

00  Y73 

00  A3  00  012 

00  Y73  02  9-3 

00  013 
04  29430 
00  VO 
00  J4 


PUT  INTO  SET 
P27 

A2 


looking  AT  SENTENCE  31 
(BE  BOY  t  MOD  THAT  J  THERE 
TOT  MA11YIK  TAM 
PROCESS  START 

translate 

PI 

P27 

P26 

RESULT  t 


PATTERN-LISTS  (PI  P?7  P26), 

(PI  P31  P30)  AND  (Pi  P34  P33)  ALL 
MATCH  THE  FL  SENTENCE  TO  A 
MATCH-DEPTH  OF  2,  AND  ARE 
TRANSLATED  IN  PARALLEL. 


(Z  Z1  TAM  > 


CONSISTENT  AFTER  GUESS 


-74< 


GUESS 

Z1 

MAL1YIK 

TRANSLATE 

PI 

P31 

P30 

RESULTI 
(Z2  Z3  TAM  ) 

GUESS 

Z3 

MAL1YIK 

TRANSLATE 

PI 

P34 

P33 

RESULTS 

<Z4  MAL1YIK  TAM  ) 

TRY 

PI 

P34 

P33 

PUT  INTO  VOCABULARY 

THAT 

TOT 

A18 


CONSISTENT  AFTER  GUESS. 


CONSISTENT  WITH  INPUT. 

THE  TRANSLATION  OF  THE  PATTERN- 
LIST  (Pi  P34  P33>  IS  CLOSEST  TO 
THE  NL  INPUT,  AND  (PI  P34  P33) 
IS  TRIED  FIRST. 


tssnssuxcsusi 
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P33 

IF  ZB  I E  HAD  PROCESSED  THE  PATTERN-L I  STS,  STARTING  WITH  THOSE 
OF  DEEPEST  MATCH-DEPTH,  IN  THE  ORDER  IN  WHICH  THEY  ARE 
CONSIDERED,  THEN  ZB  I  £  WOULD  HAVE  STARTED  PROCESSING  THE 
PATTERN-LIST  (PI  P27  P26).  ZB  I E  WOULD  HAVE  CREATED  THE  FOLLOWING 
VOCABULARY  ENTRIES* 

THAT  TOT  A25  P26 
BOY  MAL1YIK  A3  P27 

THE  LAST  ENTRY  WOULO  NOW  ASSURE  THE  (INCORRECT)  TRANSLATION  OF 
(BE  BOYtMOD  THIS)  HERE)  AS  ‘EpTO  MALlYlK  7DESi  •  .  THE  NEXT  EXAMPLE 
IS  A  SLIGHT  VARIATION  OF  THIS  ONE. 

LOOKING  AT  SENTENCE  32 
( 8E  GIRL  t  MOD  THAT  ) THERE  ) 

TA  G5V0YKA  TAM 
PROCESS  START 
MATCHED  PATTERN  LIST 
PI 
P34 
P33 

RESULT* 

(TOT  Z  TAM  ) 

translate 
PI 


•GIRL1  IS  NOT  KNOWN  IN  THE 
CONTEXT  ( A 3 , P 3 4 ) . 

NOT  CONSISTENT. 

TRANSLATE  PATTERN-LISTS 

(PI  P? 7  P?R>  AND  (Pi  P31  P30) 


P27 


IN  PARALLEL. 


RESULT  1 
<Z  Z1  TAM  ) 


CONSISTENT  AFTER  GUESS. 


GUESS 

Z1 

DEVOYKA 

TRANSLATE 

PI 

P31 

P3Q 

RESULTI 

<Z2  DEVOYICA  TAM  ) 

TRY 

PI 

P3i 

PUT  INTO  VOCABULARY 

THAT 

TA 

A21 

P30 


CONSISTENT. 

PATTERN-LIST  (Pi  P31  P30 
A  TRANSLATION  CLOSEST  TO 
NL  INPUT. 


LOOKING  AT  SENTENCE  33 

(BE  HAND  IOF  (SPEAKING  MAN  >J> 

E2T0  MOA1  RUKA 

PROCESS  START 

TRANSLATE 


GIVES 

THE 
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P2 

P39 

P38 

RESULT  I 

CE2T0  RUKA  Z  ) 

translate 

P2 

P39 

RESULT* 

(S2T0  RUKA  Z  ) 

TRANSLATE 

P4 

RESULT* 

(Z  ) 

TRANSLATE 

P2 

RESULT! 

<E2T0  Z1  ) 

TRY 

P2 

put  into  vocabulary 

(SPEAKING  MAN  ) 

MOA 1 

A30 

P24 

put  into  vocabulary 


MATCH-DEPTH  OF  2. 


NOT  CONSISTENT. 

MATCH-DEPTH  OF  1. 


NOT  CONSISTENT. 

translate  IN  parallel 

P4  AND  P?  (MATCH-DEPTH  0>. 


THE  TRANSLATION  due  to  P2  IS 
CLOSEST  TO  THE  NL  INPUT. 

BUILDING  SUBPATTERNS  P25  AND  P2«. 


i 


1 


I 
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hand 

RUXA 

A3 

P25 

PUT  INTO  SET 

P24 

A31 

NEW  PATTERN 


<P24> 

<9-1  =  29396> 

<9-2  s  27938> 

<9-3  =  2  8 1  f)  '->  > 

02  9-i 

04  0 

04  0 

04  0 

00  A29 

00  TO 

00  Y71 

00  Y71 

00  Y72 

02  9-2 

00  A30 

00  D12 

00  Y71 

02  9-3 

00  D13 

04  29418 

00  09 

00  A31 

00  VO 

00  J4 

<P25> 

<9-1  “  27180> 

<9-2  *  29464> 

<9-3  =  2fl6i^> 

02  9-1 

04  0 

04  0 

04  0 

00  A31 

00  TO 

00  Y70 

00  Y70 

00  Y70 

02  9-2 

00  Y69 

00  Y69 

00  A3 

00  012 

00  Y69 

02  9-3 

-79 


00  013 
04  20906 
00  VO 
00  J4 

PUT  INTO  SET 
P25 

A3 


LOOKING  AT  SENTENCE  34 

< be  hand  iof  (spoken  boy  >n 

E2T0  TVOA1  RUKA 

PROCESS  START 

TRANSLATE 

P2 

P25 

P24 

RESULT  * 

(E2T0  Z  RUKA  ) 

translate 

P2 

P39 

P38 

RESULT* 

(E2T0  RUKA  Zl  ) 

TRY 

P2 


TRANSLATE  IN  PARALLEL 
PATTERN  LISTS  (P2  P25  P24)  AND 
(P2  P39  P3R)  WHICH  MATCHED 
THE  FL  SENTENCE  TO  A  DEPTH  OF  2. 

CONSISTENT. 


NOT  CONSISTENT. 


f 

i 

\ 


I 
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P25 

P24 

put  into  vocabulary 

(SPOKEN  BOY  ) 

TVOAi 

A30 

P24 

LOOKING  AT  SENTENCE  35 
(BE  (ON  (BOOK  ) HAND  >> 

ONA  NA  RUKE 
PROCESS  START 

translate 

P4 

P37 

result; 

(ONA  Z  RUKE  ) 

TRY 

P4 

P37 

PUT  INTO  VOCABULARY 

ON 

NA 

A12 

COMMENT;  THIS  SLIGHTLY  UNNATURAL  SENTENCE  WAS  ADDED  TO 


P37 


-ST¬ 


AFFORD  A  SMOOTH  TRANSITION  TOWARDS  THE  NEXT  SENTENCE  WITHOUT 
BUILDING  A  NEW  SU8PATTSRN.  SEE  THE  COMMENTS  AT  THE  END  OF 
SENTENCE  36. 

LOOKING  AT  SENTENCE  36 
(BE  (ON  (BOOK  ITA8LE  )) 

ONA  NA  STOLE 
PROCESS  START 

translate 

P4 

P37 

RESULT! 

(ONA  NA  2  )  'TABLE*  IS  NOT  KNOWN  IN  THE 

TRY  CONTEXT  (A13,P37>. 

P37 

PUT  INTO  VOCABULARY 

TABLE 

STOLE 

A13 

P37 


ASSUME  THAT!  A)  THIS  SENTENCE  HAD  BEEN  PRESENTED  BEFORE 
SENTENCE  35)  B)  *  TA8LE '  WAS  KNOWN  IN  SOME  CONTEXT »  FOR  INSTANCE 
AS  'STOL'  (NOMINATIVE))  AND  C>  'ON'  WAS  NOT  KNOWN  (WHICH  WAS  THE 
CASS  HERE).  THEN  ZB  I E  WOULD  HAVE  BUILT  A  NEW  SUBPATTERN  By:  A) 
GUESSING  'TABLE'  FROM  THE  PREVIOUS  PRINT-NAME)  B)  PAIRING  (BOOK) 


1 
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WITH  ONE  ACCEPTABLE  TRANSLATION,  'ONA*.  OF  (BOOK);  C)  ASSIGNING 
•ON’  TO  THE  STILL  UNACCOUNTED  FOR  NL  STRING  »NA*.  THE  NEW 
SUBPATTERN  WOULD  HAVE  BEEN  INSERTED  IN  THE  SET  All#  ON  THE  P-LlST 
OF  P4. 


ACTUALLY,  IT  IS  NOT  NECESSARY  TO  BUILD  A  NEW  SUBPATTERN.  THE 
NEW  FL  SENTENCE  FITS  INTO  THE  PREVIOUS  PATTERN  STRUCTURE  IF  WE 
ARE  CAREFUL  TO  GIVE  ENOUGH  INTERMEDIARY  SENTENCES#  SUCH  AS 
SENTENCE  35. 


ZBIE  TENDS  TO  GENERATE  TOO  MANY  SETS  AND  PATTERNS.  IT  WOULD 

be  interesting  to  give  zbie  the  capability  to  re-organize  its 

STRUCTURES#  FOR  EXAMPLE  BY  MERGING  SOME  SETS  OR  SOME  PATTERNS. 


LOOKING  AT  SENTENCE  37 

(FUTURE  TAKE  (SPEAKING  MAN  >800K  ) 


A1  VOZ1MU  KNIG1U 


•FUTURE*  IS  A  MARKER  IN  FL#  AND 


PROCESS  START 


IS  NOT  TO  BE  TRANSLATED. 


PUT  INTO  VOCABULARY 


BUILDING  PATTERN  P5. 


800K 

KNIQiU 


PUT  INTO  VOCABULARY 
TAKE 


VOZ1MU 


A33 
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P5 

PUT  INTO  VOCABULARY 
(SPEAKING  MAN  ) 

A1  THE  RUSSIAN  LETTER. 

A2  THE  SET  NAME. 

P5 

NEW  PATTERN 


<P5> 

<9-1  =  28970> 

<9-2  a  28212> 

<9-3  = 

02  9-1 

04  0 

04  0 

04  0 

00  A32 

00  TO 

0  0  Y3 

00  Y3 

00  Y1 

02  9-2 

00  Y2 

00  Y2 

00  A33 

00  D12 

00  Y4 

00  Y 4 

00  Y2 

02  9-3 

00  A2 

00  D13 

00  Y3 

04  27858 

00  A34 

00  Y 4 

end  OF  RUN 

292<>'  > 
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CHAPTER  IV. 

A  CRITICAL  LOOK  AT  ZBIS. 


UHR'S  PROGRAMS  (1964)  MAY  WELL  GIVE  AN  ILLUMINATING  CONTRAST 
TO  SOME  OF  THE  MECHANISMS  USED  BY  ZB  I E .  UHR  SHOWS  OUTPUTS  FOR  TWO 
PROGRAMS  AND  DESCRIBES  A  =LANNED  THIRD  PROGRAM.  ALL  HIS  PROGRAMS 
LEARN  TO  TRANSLATE  A  NATURAL  LANGUAGE,  NL1,  INTO  ANOTHER  NATURAL 
LANGUAGE,  NL2, 

THE  FIRST  PROGRAM  WAS  APPLIED  TO  TRANSLATE  GERMAN  INTO 
ENGLISH.  WORDS  ARE  SEPARATED  BY  BLANKS.  THE  PROGRAM  DOES  NOT  USE 
CONTEXT  AND  RUNS  INTO  DIFFICULTIES  ON  THAT  »CCOUNT.  FOR  EXAMPLE, 
’DAS’  IN  THE  GERMAN  'DAS  I  ST  *  OR  'DAS  GLAS  *  BECOMES  RESPECTIVELY 
’THIS'  OR  ’THE'.  UHR 5  S  FIRST  PROGRAM  CANNOT  HANDLE  SUCH  A 
DIFFICULTY. 

THE  SECOND  PROGRAM,  WHICH  WAS  APPLIED  TO  TRANSLATE  ENGLISH 
INTO  FRENCH,  IS  MORE  POWERFUL  IN  SEVERAL  WAYS.  WORDS  ARE  NOT 
SEPARATED,  AND  PART  OF  THE  FUNCTION  OF  THE  PROGRAM  IS  TO  SEPARATE 
IMPORTANT  ELEMENTS  IN  A  CONTINUOUS  FLOW.  FOR  INSTANCE,  THE  'S' 
MARKING  A  PLURAL  CAN  BE  SEPARATED.  IT  IS  ALSO  MORE  DIFFICULT  TO 
TRANSLATE  A  LANGUAGE  WITH  LITTLE  INFLECTION,  SUCH  AS  ENGLISH. 
INTO  A  MORE  INFLECTED  LANGUAGE,  SUCH  AS  FRENCH,  THAN  TO  TRANSLATE 
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AN  INFLECTED  LANGUAGE,  GERMAN,  INTO  ENGLISH,  IN  THE  LATTER  CASE. 
AN  INCREASED  DICTIONARY  OrTEN  SUFFICES,  WHILE  IN  THE  FORMER  CASE. 
CONTEXT  IS  ESSENTIAL. 

TO  08TAIN  CONTEXT,  CLASSES  ARE  BUILT  ON  ELEMENTS  OF  NL2 
CLASS  CLUSTERS  ARE  USED  TO  RESOLVE  AMBIGUITIES  AND  GENERALIZE 
PERMUTATIONS.  IN  THE  GIVEN  OUTPUT,  THOUGH,  THE  PROGRAM  DOES  NOT 
SEEM  TO  LEARN  THE  GENERALIZED  PERMUTATION!  ADJECTIVE  *  NOUN  - 
NOUN  +  ADJECTIVE. 

THE  THIRD  (PROJECTED)  PROGRAM  IS  A  STRENGTHENING  OF  PROGRAM 
2.  IT  CAN  GENERATE  CLASSES  OF  CLASSES,  I.E.  ENCOMPASS  GROUPS  OF 
WOROS. 


ALL  THREE  PROGRAMS  JSE  STATISTICAL  WEIGHTS  FOR  LEARNING  AND 
UNLEARNING.  IT  APPEARS  THAT  SOME  USE  IS  MADE  OF  THE  CORRESPONDING 
ORDER  OF  THE  LANGUAGES.  IV  THE  GIVEN  EXAMPLE  1»  FROM!  ICH  BIN  E I N 
MANN  *  I  AM  A  MAN,  THE  INFERENCES  ICH  -  I,  BIN  -  AM,  FIN  -.  A, 
MANN  ■*  MAN  SEEM  TO  8E  DRAWN J  IV  EXAMPLE  1,  FROM!  IF  THE  80Y  -  SI 
L6  GARCON  AND  THE  -  LE,  THE  INFERENCES  IF  SI,  BOY  -  GARCON  SgEM 
TO  BE  DRAWN. 

LET  US  APPLY  SOME  OF  THE  A  30VE  CRITERIA  TO  Z  3 1 E .  INPUTS  TO 
ZBIE  ARE  WELL  SEPARATED  WORDS  AND  78!E‘S  STRING  MANIPULATING 
CAPABILITIES  ARE  LIMITED  TO  CHECKING  WHETHER  THE  FIRST  FEW 
CHARACTERS  OF  TWO  WORDS  ARE  IDENTICAL  OR  NOT.  ZRIE  TRIES  TO 
TRANSLATE  FROM  A  STRONGLY  NON- 1  N'FLECTED  LANGjAGE  <  F  L )  INTO 
ANOTHER  LANGUAGE,  WHICH  WILL  USUALLY  BF  INFLECTED.  THE  CLASSES 
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USEU  9Y  UHR'S  PROGRAMS  ARE  8UILT  ON  NL 7\  THE  CORRESPONDING  SETS 
ARE  BUILT  ON  Ft,  EQUIVALENT  TO  NLl,  BY  ZBIE.  THE  CLASSES  OF 
CLASSES  DESCRIBED  BY  UHR  "OR  THE  PROJECTED  PROGRAM  MAY  CORRESPOND 
TO  THE  RECURSIVE  HIERARCHY  <SUB)PATTERN  -  SET  -  SUBPATTERN.  ZB  I E 
MAKES  FEW  ASSUMPTIONS  ON  WORD  ORDER.  AND  HENCE  WAS  ABLE  TO  LEARN 
THE  SENTENCES  EXHIBITED  IN  CHAPTER  3  WHEN  THE  RUSSIAN  SENTENCES 
HAD  ALL  BEEN  PREVIOUSLY  INVERTED. 

ALL  THE  PROGRAMS  CONSIDERED  BUILD  STRUCTURES  AT  RUN-TIME  AND 
USE  THESE  STRUCTURES  TO  -EARN  FURTHER,  WHICH  MAY  IMPLY  BUILDING 
NEW  STRUCTURES. 

WE  FEEL  THAT  USIN3  A  UNIFORM,  STRUCTURED  REPRESENTATION, 

SUCH  AS  FL,  WHICH  IS  IN  SOME  SENSE  *  UNDERSTOOD » ,  GIVES  ZBIE  A 

GREAT  ADVANTAGE  OVER  A  FLAT  STRING  INPUT.  IT  DESTROYS  THE 

SYMMETRY  THAT  UHR  *  S  PROGRAMS  POSSESS.  IT  MAY  BE  THAT  STRUCTURES 
AS  POWERFUL  AS  (OR  EVEN  MORE  POWERFUL  THAN)  THOSE  BUILT  IN  FL  CAN 
BE  CONSTRUCTED  EVENTUALLY  BY  PROGRAMS  STARTING  FROM 

(UNSTRUCTURED)  STRINGS. 

WE  HAVE  ALREADY  ENCOUNTERED  VARIOUS  DEFICIENCIES  IN  ZBIE 
SOME  OF  THESE  COULD  8=  SOLVED  BY  MORE  PROGRAMMING}  OTHERS 
NECESSITATE  A  THOROUGH  RETHINKING  OF  THE  LEARNING  TASK. 

AMONG  THE  FIRST  WE  SHOULD  MENTION: 

-  THE  INITIALIZATION  PHASE  IS  INFLEXIBLE.  SENTENCES  COULD  BE 
STORED  UNTIL  TWO  SENTENCES  MEET  THE  CONDITIONS  TO  INITIALIZE  THE 
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FIRST  PATTERN. 

-  THE  TRANSLATION  RULES  SHOULD  BE  MORE  GENERAL.  WE  GAVE  IN 
CHAPTER  II,  PART  8,  TWO  KINDS  OF  DESIRABLE  TRANSLATION  RULES 
WHICH  ARE  PRESENTLY  NOT  USED  BY  ZBIE. 

-  THE  METHODS  TO  OBTAIN  ‘GOOD  GUESSES'  SHOULD  BE  IMPROVED. 
THESE  METHODS  COULD  USE,  FOR  INSTANCE,  SOME  OF  THE  SEMANTICS 
BUILT  INTO  FL  (SEE  BELOW). 

THE  STRING  MANPULATING  CAPABILITIES  SHOULD  EE  MORE 
VERSATILE,  IN  PARTICULAR,  PREFIXES  AND  SUFFIXES  SHOULD  BE 
DISCOVERED,  THEREBY  ALLOWING  GENERALIZATIONS  OF  TRANSLATIONS.  FOR 
EXAMPLE!  THE  TRANSLATION  OF  AN  ELEMENT  FL l  IN  THE  CONTEXT  AI,  PI 
IS  OBTAINED  BY  ADDING  SOME  STRING  IN  NL  TO  THE  TRANSLATION  OF  THE 
SAME  ELEMENT  FL  I  IN  SOME  OTHER  CONTEXT  AvI,  PJ. 

-  A  PATTERN  SHOULD  HAVE  SEVERAL  TRANSLATION  RULES  TO  REFLECT 
DIFFERENT  WAYS  IN  WHICH  THE  SAME  SITUATION  CAN  BE  EXPRESSED  IN 
NL. 


-  AS  THE  NUMBER  OF  ( SU3 ) PATTERNS  INCREASES,  HEURISTICS  (MAyBE 
OF  A  SEMANTIC  NATURE)  MUST  BE  USED  TO  SPEED  UP  SEARCH  DURING 
MATCHING. 

-  PRESENTLY,  THE  CONTEXT  OF  THE  (MAIN)  VERB  IS  THE  WHOLE 
PATTERN.  SO  THAT,  AS  THE  SAME  VERB  (IN  FL )  CHANGES  (IN  NL>,  A  NEW 
TOP  PATTERN  IS  CREATED.  IN  THIS  WAY,  THE  NUMBER  OF  PATTERNS 
INCREASES  MUCH  TOO  RAPIDLY. 
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BESIDES  STRUCTURE,  W=  TRIEO  TO  BUILD  SOME  SEMANTICS  INTO  PL. 
WE  CAN  SPECIFY  THE  REVERENT  OF  A  PRONOUN.  WE  CAN  INDEX,  IF 
NECESSARY,  SEVERAL  PERSONS  APPEARING  IN  A  SITUATION  TO 
DIFFERENTIATE  AMONG  THEM,  JUST  AS  THEY  MAY  BE  DIFFERENTIATED  IN  A 
PICTURE.  UNTIL  NOW,  THOJGH,  NO  USE  HAS  BEEN  MADE  OF  THE  CONTENT 
OF  THE  SITUATIONS. 

A  FIRST  STEP,  WHICH  WAS  NEARLY  IMPLEMENTED,  IS  TO  USE 
FINDINGS  SUCH  ASt  THE  SUBJECT  PRONOUNS  (MAN)  AND  (BOY>  H*VE 
IDENTICAL  TRANSLATIONS  IN  RUSSIAN.  WE  COULD  USE  THIS  FINDING  TO 
MAKE  'GOOD  GUESSES'  ON  HOW  'MAN'  AND  'BOY'  WILL  BEHAVE  IN  SIMILAR 
SITUATIONS.  WE  COULD  ALSO  USE  THE  FUNCTIONAL  LANGUAGE  DESCRIPTION 
OF  t  (SPEAKING  MAN l NUM8ER  21),  (SPEAKING  (AND  MaN  WOMAN)),  ETC... 
TO  OBTAIN  THE  NOTION  OF  (SPEAKING  PLURAL). 

A  SECOND  STEP  WOULD  BE  TO  PROCESS  SEVERAL  SITUATIONS  WHICH 
ARE  DYNAMICALLY  RELATED.  SEQUENCES  SUCH  AS  *  THE  BOOK  IS  ON  THE 
TABLE,  I  SHALL  TAKE  THE  800K  IN  MY  HAND,  I  AM  TAKING  THE  BOOK, 
THE  BOOK  IS  IN  MY  HAND,  IT  WAS  ON  THE  TABLE,  ETC...  ARE  USED  By 
I.  A.  RICHARDS  TO  TEACH  TENSES. 

A  SIMPLE  SCHEME  0-  SET  INCLUSION  TESTS  ALONE.  AS  USED  BY 
ZBI£,  IS  NOT  POWERFUL  ENOUGH  TO  LEARN,  FOR  EXAMPLE,  THE  RUSSIAN 
REFLEXIVE  POSSESSIVE  SVOli.  A  MORE  POWERFUL  SCHEME  WHICH  LOOKS  AT 
CORRELATIONS  AMONG  ELEMENTS  IN  THE  FUNCTIONAL  LANGUAGE  IS  NEEDED: 


IN  THE  FL  SENTENCE 
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(PUT  (  PERS0N1 )  (IN  HATOF  ( PERSON?  )  J  DRAWER)) 

ARE  PERS0N1  AND  PERS0N2  T HE  SAME . 

THE  ABOVE  DEFICIENCIES  CAN  BE  OVERCOME  BY  MAKING  BETTER  USE 
OF  FL,  WE  MUST  ALSO  QUESTION  THE  USE  OF  FL. 

THE  PURPOSE  OF  FL  WAS  DESCRIBED  IN  CHAPTER  II  .  UNDOUBTEDLY, 
THE  ’VISION  OF  THE  WORLD*  AS  REPRESENTED  BY  Ft  IS  VERY  CLOSE  TO 
AN  INDO-EUROPEAN’S  ’VISION  OF  THE  WORLD’.  IT  MAy  SE  P0SSI8LE  THAT 
A  SYSTEM  COULD  DISCARD  THE  FUNCTIONAL  LANGUAGE  AND  BOOTSTRAP 
ITSELF  TO  LOOK  AT  THE  WOR.D  IN  THE  LEARNED  NATURAL  LANGUAGE. 

THE  RUNNING  SYSTEM. 

PROGRAMMING  28 1 E  HAS  BEEN  A  WORTHWHILE  EXPERIENCE.  THE 
PROGRAM  GENERATED  SOME  SURPRISES.  THE  MECHANISMS  FOR  AVOIDING 
ERRORS  WERE  NOT  VERY  CLEAR  AT  THE  START.  THE  ADVANTAGE  IN 
TRANSLATING  IN  PARALLEL  PATTERN  LISTS  OF  A  GIVEN  DEPTH  HAD  NOT 

been  foreseen j  it  was  thought  that  a  simple  historic  monitor: 

LAST  PATTERN  LIST  OBTAINED,  FIRST  TRIED,  WOULD  SB  ADEouATE. 

AT  PRESENT,  THE  PATTERN  BUILDING  ROUTINES  CAN  HANDLE  ONLY  FL 
ELEMENTS  WHICH  HAVE  SINGLE  ML  WORDS  AS  TRANSLATIONS.  (ThIS 
LIMITATION  CAN  BE  OVERCOME  BY  ADDITIONAL  PROGRAMMING.) 
CONSEQUENTLY,  ZBI6  WOULD  8RANCH  TO  AN  EMPTY  ExlT  WHEN  TRYING  TO 
PROCESS,  IN  FRENCH,  PENCIL  ■*  LE  CRAYON  (TWO  NL  WORDS).  DEALING 
WITH  ARTICLES,  MOSTLY  UNNECESSARY  BUT  CUMBERSOME  OBJECTS,  POSES 
SOME  PR08LEMS.  IF  PENCI_  -»  LE  CRAYON,  AND  IF  WE  ALSO  KNOW  THAT 
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BED  <♦  LE  LIT  AND  WALL  ■*  LE  MUR*  WE  COULD  CONCLUDE  THAT  »LE«  IS  AN 
UNNECESSARY  OBJECT.  THEN  IF  WE  MEET  PENCIL  UN  CRAyON 
(POSSIBLY)*  WE  CAN  ASSJME  THAT  *UN»  IS  ALSO  AN  UNNECESSARY 
OBJECT.  THE  SCHEME  COLLAPSES  NEXT «  THOUGH,  WHEN  WE  MEET  PENCIL 
--*•  SON  CRAYON  (HIS  OR  HER  PENCIL).  HERE  A  TEACHER  MAY  WELL  BE 
NEEDED . 

A  ’GOOD*  TEACHING  SEQUENCE  IS  PROBABLY  VERY  IMPORTANT.  EVEN 
WITH  A  GOOD  SEQUENCE*  THOUGH*  A  TIME  WILL  COME  WHEN  SOME  BAD 
GENERALIZATIONS  HAVE  8EEN  MADE*  AND  THESE  MUST  BE  UNLEARNED.  ZB  I E 
is  careful  enough  to  avoid  mistakes  so  that,  at  the  elementary 

LEVEL  CONSIDERED*  ERROR  RECOVERY  IS  NOT  NEEDED.  WE  HAVE  NO 
EXCITING  SCHEME  TO  PROPOSE.  FOR  ERROR  RECOVERY*  IT  APPEARS  THAT 
SUITABLE  CHANGES  IN  SET  MEMBERSHIPS  MAY  BE  SUFFICIENT  IN  SOME 
CASES,  BUT  ADDITIONAL  WORK  AT  A  MORE  ADVANCED  LEVEL  OF  LANGUAGE 
PROFICIENCY  IS  IN  ORDER. 
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CHAPTER  V. 

ENVOI 


ZB  I E  ! S  A  PROGRAM  OF  MEDIUM  LENGTH  {ABOUT  5000  LINES  OF 
IPL-V  CODE)  WHICH  TRIES  TO  SOLVE  SOME  ASPECTS  OF  A  TASK  THAT  MAY 
OR  MAY  NOT  BE  VERY  D I FF I  CULT  «  NATURAL  LANGUAGE  LEARNING.  ZB  I E 
INTERPRETS  THE  TASK  AS  LEARNING  TO  EXPRESS  IN  A  NATURAL  LANGUAGE 
SITUATIONS  AS  DESCRIBED  IN  A  UNIFORM,  STRUCTURED  FUNCTIONAL 
LANGUAGE,  WHICH  MAY  BE  CONSIDERED  AS  GIVING  SOME  CONTENT  TO  THE 
SITUATIONS,  ALTHOUGH  ACTUALLY  VERY  LITTLE  OF  THE  POWER  OF  THE 
FUNCTIONAL  LANGUAGE  IS  USED. 

TO  LEARN  A  LANGUAGE,  ZB  I E  BUILDS  ELEMENTARY  STRUCTURES  AT 
RUN-TIMEI  SETS,  PATTERNS,  SIMPLE  TRANSLATION  RULES,  AN  IN-CONTEXT 
VOCABULARY.  IT  IS  CAPABLE  OF  SOMEWHAT  IMPROVING  ITS  STRUCTURE  TO 
THE  EFFECT  THAT  SOME  PREVIOUSLY  LEARNED  INSTANCE  CAN  BE  LEARNED 
IN  A  BETTER  WAY.  IT  DOES  NOT  USE  STATISTICAL  LEARNING  SCHEMES. 
IT  HAS  SOME  ERROR-AVOIDING  CAPABILITY,  AND  •  HAS  POTENTIAL 
ERROR-RECOVERY  POSS I B I L I T I ES  WHICH  WERE  ACTUALLY  NOT  NEEDED  AT 
THE  MODEST  LEVEL  CONSIDERED  HERE.  AS  COULD  BE  EXPECTED,  ZBlE  USES 
CONTEXT  BOTH  TO  LEARN  AND  TO  AVOID  ERRORS. 

GIVEN  SITUATIONS  ARE  PARSED  IN  THE  FUNCTIONAL  LANGUAGE,  NOT 
IN  THE  NATURAL  LANGUAGE)  THE  PARSING  GIVES  A  MEASURE  OF  HOW  CLOSE 
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A  MEM  SITUATION  IS  TO  CERTAIN  CLASSES  OF  PREVIOUSLY  ENCOUNTERED 
SITUATIONS*  ZB  I E  TRIES  TO  MINIMIZE  ITS  LEARNING  AT  EACH  STAGE  BY 
TRYING  TO  CAPITALIZE  ON  THE  MAXIMUM  AMOUNT  OF  INFORMATION 
AVAILABLE  FROM  PREVIOUS  SITUATIONS,  MEASURED,  QUITE  SIMPLY,  BY 
THE  DEPTH  TO  WHICH  A  NEW  SITUATION  IS  PARSED  BY  A  COLLECTION  OF 
PATTERNS.  IN  FACT,  Z9IE  ABANDONS  THE  LEARNING  TASK  WHEN  FACED 
WITH  SITUATIONS  THAT  IT  CONSIDERS  TOO  DIFFICULT  TO  HANDLE  AT  A 
GIVEN  STAGE.  SINCE  IT  CAN  DIAGNOSE  THE  PARTICULAR  DIFFICULTIES 
ENCOUNTERED,  ZBIE  COU.D  ASK  APPROPRIATE  QUESTIONS  IN  A 
TIME-SHARING  ENVIRONMENT. 

IT  WOULD  APPEAR  THAT  THE  FUNCTIONAL  LANGUAGE  SHOULD  POSSESS 
IN  ITS  DESCRIPTION  ALL  THE  SEMANTIC  SUBTLETIES  OF  THE  NATURAL 
LANGUAGE  LEARNT,  AN  UNAPPEALING  FACT.  A  MUCH  MORE  POWERFUL  SYSTEM 
MAY  BE  ABLE  TO  BOOTSTRAP  ITSElF  AND  USE  THE  NATURAL  LANGUAGE  IT 
HAS  STARTED  TO  LEARN  AS  ITS  MAIN  REPRESENTATION,  WITH  POSSIBLE 
REFERENCES  FROM  TIME  TO  TIME  TO  THE  FUNCTIONAL  LANGUAGE.  SEMANTIC 
SUBTLETIES  COULD  THEN  3E  DESCRlPED  IN  THE  NATURAL  LANGUAGE 
ITSELF. 

IT  APPEARS  TO  BE  FRUITFUL  TO  LOOK  AT  NATURAL  LANGUAGES  AS 
WAYS  TO  EXPRESS  SITUATIONS  WITH  STRUCTURE  AND  CONTENT.  MUCH 
VALUABLE  RESEARCH  CAN  3E  DONE  IN  AREAS  TOUCHED  UPON  BY  ZBIE, 
AMONG  WHICH  THE  DESIGN  O'  MORE  POWERFUL,  SEMANTICALLY  ORIENTED. 
FUNCTIONAL  LANGUAGES J  THE  PROBLEM  OF  FRRQR  RECOVERY,  AND  THE 
EVOLUTIONARY  REORGANIZATION  AND  IMPROVEMENT  OF  STRUCTURES  MAY 
WELL  BE  THE  MOST  INTERESTING  ANO  CHALLENGING. 
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APPENDIX  A. 


CODE  FOR  CYRILLIC  ALPHABET. 
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APPENDIX  B. 


'EVOLUTIONARY  LEARNING* . 


WE  ARE  PRESENTING  HERE  A  SHORT  EXAMPLE#  IN  GERMAN, 
EXHIBITING  AN  ASPECT  OF  Z3IE'S  CAPABILITIES.  THE  TRANSLATION  RULE 
OF  PATTERN  PI  IS  INCORRECT.  AS  MORE  EXAMPLES  ARE  GIVEN,  THOUGH, 
2816  BUILDS  NEW  PATTERNS  P2  AND  P3.  THE  SENTENCES  WHICH  WERE 
PREVIOUSLY  TRANSLATED  WHEN  REACHING  PATTERN  Pi  ARE  NOW  TRANSLATED 
WHEN  REACHING  PATTERNS  P?  OR  P3,  SO  THAT  PATTERN  PI  IS  NOT 
REACHED  ANY  MORE.  PATTERN  PI  HAS  EFFECTIVELY  BEEN  WASHED  OUT. 

THE  OUTPUT  IS  REPRODUCED  AS  OBTAINED  FROM  THE  PRINTER- 
INPUTS  IN  IPL-V  FORM  HAVE  8EEN  DELETED  EXCEPT  IN  ONE  ILLUSTRATIVE 
CASE. 


THE  IMPORTANT  ATTRIBUTES  AND  VALUES  OF  A  PATTERN  PJ  HAVE  THE 
FOLLOWING  MEANING* 

TO(PJ)  =  TRANSLATION  RULE  (A  LIST  STRUCTURE). 

PO(FJ)  =  A  LIST  OF  PATTERNS  WITH  A  P-LIST  IDENTICAL  TO  PJ. 

THE  OTHER  ATTRIBUTES  ARE  USED  FOR  BOOK-KEEPING  AND  MAY  BE 
DISREGARDED. 


COMMENTS  ARE  GIVEN  AT  THE  RIGHT  OF  INPUTS#  OR  AT  THE  END  OF 
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the  processing  op  a  sentence. 


looking  at  sentence 

(BE  (WOMAN  ) HERE  ) 
SIE  1ST  HIER 
(BE  (WOMAN  ) THERE  ) 
SIE  1ST  DORT 
PROCESS  START 

put  into  vocabulary 

(BE  (WOMAN  )) 

(SIE  1ST  ) 

P 

PUT  INTO  VOCABULARY 

HERE 

HIE  R 

A3 

P 

put  into  vocabulary 

THERE 

DORT 

A3 


COMMENTS 


THE  FIRST  TWO  SENTENCES 
TO  START  THE  INITIALIZATION 
8F  IS  IN  SET  Ail  (WOMAN)  Jkj  sgy  A? 

CONTEXT  VOCABULARY  FOR  FL  COMPLEX 

IN-CONTEXT  VOCABULARY  For  Fl 
UNIT.  THE  FL  UNIT  (IN  THIS  CASE* 
HERE)  IS  INSERTED  In  THE  SET  (IN 
THIS  CASE.  A3) .  P=Po. 


P 

NEW  PATTERN 

<PG> 

0?  9-1 
00  A1 


<9-1  =  25256> 
04  0 
00  TO 


<9~?  =  254f>?> 
04  0 

OP  9-3 


<0-3  =  > 

04  n 
00  Y 1 
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00  Y1  02  9-2  00  Y3  00  Y2 
00  A2 

00  Y2 
00  A3 
00  Y3 


COMMENT!  THE  INITIALIZATION  PHASE  IS  OVER.  FOR  THE  NEXT 
SENTENCE,  WE  SHOW  THE  IPL-V  INPUT. 


IP  INPUT  DATA  5 


X4 

95 

0 

95 

0 

IP  rfE 

EO 

IP  (MANINUM8  2)  ) 

91 

IP  THERE 

E4 

0 

IP 

9-1 

0 

IP 

0 

IP  (NUMB  2) 

92 

IP  MAN 

E2 

0 

IP 

92 

0 

IP  NUMB 

ElO 

IP  2 

El3 

0 

IP 

X3 

95 

0 

IP 

95 

0 

IP  SIE 

RO 

IP  SIND 

R  4 

“9  7- 


IP  OORT 


«3  0 


IP 


5  JO 


H?  *  2339  CELLS  OOlOOSQfi 


LOOKING  AT  SENTENCE 

(BE  (MAN  INUMB  2  ) ) THERE 

SIE  SIND  DORT 

PROCESS  START 

TRY  PATTERN 

P 

NOT  HATCHED. 

try  learn  from  pattern 

p 

( 2  OORT) 

PUT  INTO  VOCABULARY 
(BE  (MAN  (NUMB  ?  ]  )  ) 

(SJS  SIND  ) 

P 


THE  INPUTS  ARE  FIRST  PRINTED 


( BE ( M AN ( NUMB  9))  IS  TwE  UNTRANS¬ 
LATED  PART,  CORRESPONDING  to  I 


PUT  INTO  vocabulary  pattern  P1  ,s  being  built 

(MAN  (NUM8  2  ) ) 

SI  NO 

A2 

PI 

PUT  into  vocabulary 
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8E 
S  I  6 
A1 
PI 


NEW 

PATTERN 

<P1> 

<9-1 

=  25256>  <9-2  = 

25774> 

<9-3  =  28* 

02 

9-1 

04 

0  04  0 

04  0 

00 

Ai 

00 

PO  00  PO 

00  Y1 

00 

Y1 

02 

9-2 

00  Y2 

00 

A2 

00 

YO 

00  Y3 

00 

Y2 

00 

J3 

00 

A3 

00 

J  4 

00 

Y3 

00 

J3 

00 

TO 

02 

9-3 

COMMENT? 

PATTERN  Pi  HAS  A  P-LIST  IDENTICAL  TO  THE  P-LIST  OF 

PO  . 

HOWEVER, 

THE 

TRANSLATION  PULES  ARE 

DIFFERENT. 

ZBIE  USED 

( BE ( WOMAN ) )  - 

SIE 

1ST.  AND  <BE(MAN(NUM8 

2) >  >  -  SIE 

SIND,  BOTH 

translations  in  the  context  op  the  pattern  po,  For  MATCH  BACK 
the  common  parts  IN  FL  AND  NL,  RESPECTIVELY  'BE'  AND  'SIE',  WERE 
PAIRED.  THE  COMPARISON  OF  THE  NON-COMMON  PARTS  GAVE  ( M AN [ NUMB  ?)) 
*  SIND  (CONTEXT  A2,P1>.  THE  INFERENCE  IS  GRAMMATICALLY  INCORRECT. 
NOTE  THAT  THE  TRANSLATION  RULE  IS  <Y1  Y2  Y3>,  IN  THF  SAME  ORDER 
AS  THE  SETS.  IT  IS  WEL,  WORTH  COMPARING  THIS  PATTERN  PI  TO  THE 
PATTERN  Pi  CREATED  BY  ZB  I E  WHEN  LEARNING  RUSSIAN  (SEE  CHAPTER 
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lll ). 

LOOKING  at  sentence 

(BE  (WOMAN  ) HERE  ) 

S  IE  1ST  HIER 
PROCESS  START 

try  pattern 
pi 

pattern  MATCHED.  RESULTt 
(SIE  z  Zl  ) 

TRY  PATTERN 
P 

PATTERN  MATCHED.  RESULT I 
(SIE  1ST  HIER  ) 

TRY  LEARN  MORE 

TRY  LEARN  From  pattern 

pi 

(SIE  z  Zl  ) 

GUESS 

Zl 

kjer 

put  into  vocabulary 
(woman  ) 

1ST 

A2 

PI 


THE  FIRST  SENTENCE  AGAIN 


(WOMAN)  IS  NOT  KNOWN  IN  jwE 
CONTEXT  (A?, Pi),  HENCE  THE  Z 
ID.  FOR  HERE,  (A3,  PD  AND  Zl 

THE  PATTERN  Pi  WAS  THE  FIRST  TO 
BF  TOTALLY  MATCHED,  BuT  WAS  NOT 
SUCCESSFULLY  TRANSLATED 

Z  <  I  •  F .  (WOMAN))  IS  NOT  GUESSED 

but  zi  is»  giving  a  consistent 
TRANSLATION  WITH  the  INPUT 


I 


? 


- 1  fi  c  - 


PUT  INTO  VOCABULARY 

HERE  NOW  ’HERE'  IS  ALSO  KNOWN 

HIER  IN  THE  CONTEXT  <A3,Pl) 

A3 

Pi 


COMMENT?  NOW  (8E  (WOMAN)  HERE)  WILL  BE  TRANSLATED  By  PATTERN  P\. 


LOOKING  AT  SENTENCE 
(8E  (MAN  ) HERE  ) 

ER  1ST  HIER 
PROCESS  START 
TRY  PATTERN 
PI 

NOT  MATCHED. 

TRY  PATTERN 
P 

NOT  MATCHED. 

TRY  LEARN  FROM  PATTERN 
PI 

(SI6  Z  HIER) 

TRY  LEARN  FROM  PATTERN 
P 

(Z  HlgR) 

PUT  INTO  VOCABULARY 


A  NSW  SENTENCE 


(MAN)  IS  NOT  IN  A2 
AS  THE  P-LISTS  OF  PQ  AND  PI  ARE 
IDENTICAL,  IT  IS  NOT  NECESSARY 
TO  ACTUALLY  MATCH  PQ 


NOT  CONSISTENT  WITH  INPUT 


Z  STANDS  FOR  THE  UNKNOWN 
TRANSLATION  OF  ( BE ( MAN ) > 


(BE  (MAN  )) 
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c ER  1ST  ) 

p 

PUT  INTO  VOCABULARY  CREATING  PATTERN  P 2 

(MAN  ) 

ER 

A2 

P2 

PUT  INTO  VOCABULARY 

BE 

1ST 

A1 

P2 

NEW  PATTERN 

<P2>  <9-1  =  25914>  <9-2  *  26054>  <9-3  =  2‘5B5*-> 


02 

9-1 

04 

0 

04 

0 

04 

0 

00 

A1 

00 

PO 

00 

PO 

00 

Y2 

00 

Y1 

02 

9-2 

00 

PI 

00 

Y1 

00 

A2 

00 

YO 

00 

Y3 

00 

Y2 

00 

J3 

00 

A3 

00 

J4 

00 

Y3 

00 

J3 

00 

TO 

02 

9-3 

COMM6NTJ  WE  MATCHED  BACK  (  BE  (  MAN )  )  ■*  ER  1ST  AND  ( BE ( WOMAN  >  ) 
SIE  1ST,  TO  OBTAIN  A  NEW  PATTERN  P?.  THE  TRANSLATION  RULE  OF 
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P 2,  <Y2  Y1  Y3>,  IS  DIFFERENT  FROM  THE  TRANSLATION  RULE  OF  Pi  AND 

IS  GRAMMATICALLY  CORRECT.  NOTE  that  the  translation  rule  contains 

A  TRANSFORMATION. 

LOOKING  at  sentence 

(BE  (WOMAN  ) HERE  ) 

SIE  1ST  HIER  AGAIN  THE  FIRST  SENTENCE 

PROCESS  START 
TRY  PATTERN 
P2 

PATTERN  MATCHED.  RESULTi 
(Z  1ST  Z1  > 

TRY  PATTERN 
Pi 

PATTERN  MATCHED.  RESULT i 

(SIE  1ST  HIER)  NOW  TRANSLATED  BY  Pi 

TRY  LEARN  MORE 

try  learn  from  pattern 
P2 

(Z  1ST  zi  > 

GUESS 

Zl 

HIER 

PUT  INTO  VOCABULARY 
HERE 


HIER 
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A3 

P2 

put  into  vocabulary 
(woman  ) 

SIE 

A2 

P2 

LOOKING  at  sentence 

(BE  (SPEAKING  MAN  (NUMB  2 

WIR  SIND  HIER 

PROCESS  START 

TRY  PATTERN 

P3 

NOT  MATCHED. 

TRY  PATTERN 
PI 

NOT  MATCHED. 

TRY  PATTERN 
P 

NOT  MATCHED. 

TRY  LEARN  PROM  PATTERN 
P2 

(Z  1ST  HIER) 

try  learn  from  pattern 


NOW  THE  SENTENCE  WILL  8E 
TRANSLATED  BY  P2 

1  ) HERE  ) 

A  NEW  SENTENCE 

(SPEAKING  MAN ( NUMB  ? J )  IS 
NOT  IN  A 2 


NOT  CONSISTENT  WITH  INPUT 


PI 
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< S 1 1:  1  HIER  ) 

TRY  LEARN  FROM  PATTERN 
P 

(Z  HI6R  ) 

put  into  vocabulary 

(BE  (SPEAKING  MAN  { NUMB  2  I)» 

(WIR  SIND  ) 

P 

PUT  INTO  VOCABULARY  CREATING  PATTERN  P3 

(SPEAKING  MAN  (NUMB  2  I) 

WIR 

A2 

P3 

put  into  vocabulary 

BE 

SIND 

A1 

P3 

NEW  PATTERN 


<P3> 

<9-1  =  25  530 

<9-2  =  26328> 

<9-3  = 

02  9-1 

04  0 

04  0 

04  0 

00  A1 

00  P 0 

00  PO 

00  Y2 

00  Y1 

02  9-2 

00  P? 

00  V1 

00  A2 

00  YO 

00  Pt 

00  Y3 

00  Y2 

00  J3 

00  A3 

00  J4 

2M  ^  > 
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00  Y3 


00  J3 
00  TO 
02  9-3 


COMMENT  I 
BUT  *  8E  *  Is 
<Ai,P3) . 


T«6  TRANSLATION  RULES  OR  P3  AND  Pp  m  IDENTICtu 

translated  differently  in  THE  contexts  (A1.P2)  and 


LOOKING  at  sentence 
(be  (man  j numb  2  j  jthere 
SIS  SIND  dort 
PROCESS  start 
try  pattern 

P  3 

PATTERN  MATCHED.  RESULT! 
(2  SIND  Zi  ) 

try  pattern 

P2 

PATTERN  MATCHED.  RESULT » 
<2  1ST  21  ) 

try  pattern 

PI 

PATTERN  matched,  result: 
(SI6  SIND  2  ) 

TRY  PATTERN 
P 


THE  THIRD  SENTENCE  AGAIN 


pattern  matched.  RESULT: 
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(SIE  SIND  DORT  ) 

TRY  LEARN  MORE 

TRY  LEARN  FROM  PATTERN 

P3 

(Z  SIND  Z1  } 

GUESS 

Z1 

DORT 

PUT  INTO  VOCABULARY 

THERE 

DORT 

A3 

P3 

PUT  INTO  VOCABULARY 
(MAN  (NUMB  2  ) ) 

SIE 

A2 

P3 


THE  TRANSLATION  IS  CONSISTENT  WITH 
THE  INPUT  EVEN  WITHOUT  THE  GUESS 
OF  21  (STANDING  FOR  'THERE*) 


NOW  THE  SENTENCE  WILL  BE 
TRANSLATED  BY  P3 


COMMENT  5  WE  SHALL  NOW  GIVE  SENTENCES  ONE  AND  THREE  AGAIN, 
AND  SHOW  HOW  THEY  ARE  TRANSLATED  PY  P2  AND  P3  RESPECTIVELY.  THE 
PATTERN  PI  IS  NOT  REACHED  ANY  MORE. 


LOOKING  AT  SENTENCE 
(BE  (WOMAN  ) HERE  ) 
SIE  1ST  HIER 


PROCESS  START 


r*H* 
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TRY  PATTERN 
P3 

PATTERN  MATCHED.  RESULT* 

(Z  SIND  Z1  ) 

TRY  PATTERN 
P2 

PATTERN  MATCHED.  RESULT! 

(SIS  1ST  HIER  ) 

TRY  LEARN  MORE 

try  learn  from  PATTERN 

P3 

(Z  SIND  Zl)  NOT  CONSISTENT 

LOOKING  AT  SENTENCE 

(BE  (MAN  (NUMB  2  J ) THERE  ) 

SIE  SIND  DORT 
PROCESS  START 
TRY  PATTERN 
P3 

PATTERN  MATCHED.  RESULT! 

(SIE  SIND  DORT  > 

END  OF  RUN 


. - . — - . . . -  -  • . . ----- . -- 


r 
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L/vt rnlng  a  natural  language  1?  taken  as  an  Improvement.  In  a 
system's  ability  to  express  situations  'n  a  natural  language. 

Till  ’,  dissertation  describes  a  computer  program,  called  ZMe, 
written  In  IPL-V,  which  accepts  the  description  of  situations  In 
a  uniform,  structured  functional  languageand  tries  to  express 
these  situations  In  a  natural  language.  Examoles  are  given  for 
German  and,  mostly,  Russian. 

At  run-time,  Zble  builds  simple  memory  structures.  Patterns 
and  sets  are  built  on  the  functional  language.  The  translation  rules 
of  the  patterns  and  an  In-context  vocabulary  provide  the  transition 
to  the  natural  language.  Zble  Is  a  cautious  learner,  and  avoids  error 
by  several  mechanisms.  Zble  Is  capable  of  some  evolutionary  learn'n-  . 
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